Comment by Stuart J. Russell

Below middling levels of capability, probably a net benefit. As they become more capable, open-weight models become much more dangerous than closed-weight models. For instance, imagine if five billion people had free access to an open-weight model mo...

This is not a ban or even a moratorium in the usual sense. It’s simply a proposal to require adequate safety measures for a technology that, according to its developers, has a significant chance to cause human extinction. Is that too much to ask?

This is not a ban or even a moratorium in the usual sense. It’s simply a proposal to require adequate safety measures for a technology that, according to its developers, has a significant chance to cause human extinction. Is that too much to ask?