Eliezer Yudkowsky

There ought to be a law against further escalation of AGI capabilities, trying to halt it short of the point where it births superintelligence. A line drawn sharply and conservatively, because we don't know how much further we can dance across this m...

The moratorium on new large training runs needs to be indefinite and worldwide. There can be no exceptions, including for governments or militaries. [...] Shut down all the large GPU clusters (the large computer farms where the most powerful AIs are ...

But open sourcing, that's just sheer catastrophe. [...] wrong approach, the wrong ideal. [...] where if you could align it it would take time [...] not kill everyone.

But open sourcing, that's just sheer catastrophe. [...] wrong approach, the wrong ideal. [...] where if you could align it it would take time [...] not kill everyone.

the most likely result of building a superhumanly smart AI, under anything remotely like the current circumstances, is that literally everyone on Earth will die.

Make immediate multinational agreements to prevent the prohibited activities from moving elsewhere. [...] preventing AI extinction scenarios is considered a priority above preventing a [...] nuclear exchange

The moratorium on new large training runs needs to be indefinite and worldwide. There can be no exceptions, including for governments or militaries. If the policy starts with the U.S., then China needs to see that the U.S. is not seeking an advantage...