Comment by Stuart J. Russell

Frontier AI companies should grant embedded evaluators access equivalent to that of their own highly privileged employees for the purposes of their evaluations, and with exceptions to protect sensitive data belonging to the company’s customers and ot...

This is not a ban or even a moratorium in the usual sense. It’s simply a proposal to require adequate safety measures for a technology that, according to its developers, has a significant chance to cause human extinction. Is that too much to ask?

"I've spoken to engineers in those companies who think it's now 60 or 70%," Russell said, referring to the probability of catastrophic outcomes from AI development. "So we're off by a factor of 10 to 50 million. And so that's not a very impressive en...