Comment by Stuart J. Russell

Frontier AI companies should grant embedded evaluators access equivalent to that of their own highly privileged employees for the purposes of their evaluations, and with exceptions to protect sensitive data belonging to the company’s customers and ot...

Below middling levels of capability, probably a net benefit. As they become more capable, open-weight models become much more dangerous than closed-weight models. For instance, imagine if five billion people had free access to an open-weight model mo...

This is not a ban or even a moratorium in the usual sense. It’s simply a proposal to require adequate safety measures for a technology that, according to its developers, has a significant chance to cause human extinction. Is that too much to ask?