Eliezer Yudkowsky

There ought to be a law against further escalation of AGI capabilities, trying to halt it short of the point where it births superintelligence. A line drawn sharply and conservatively, because we don't know how much further we can dance across this m...

the most likely result of building a superhumanly smart AI, under anything remotely like the current circumstances, is that literally everyone on Earth will die.

Make immediate multinational agreements to prevent the prohibited activities from moving elsewhere. [...] preventing AI extinction scenarios is considered a priority above preventing a [...] nuclear exchange

Many researchers steeped in these issues, including myself, expect that the most likely result of building a superhumanly smart AI, under anything remotely like the current circumstances, is that literally everyone on Earth will die. Not as in “maybe...