Eliezer Yudkowsky

There ought to be a law against further escalation of AGI capabilities, trying to halt it short of the point where it births superintelligence. A line drawn sharply and conservatively, because we don't know how much further we can dance across this m...

But open sourcing, that's just sheer catastrophe. [...] wrong approach, the wrong ideal. [...] where if you could align it it would take time [...] not kill everyone.

Many researchers steeped in these issues, including myself, expect that the most likely result of building a superhumanly smart AI, under anything remotely like the current circumstances, is that literally everyone on Earth will die. Not as in “maybe...