Eliezer Yudkowsky

I'm skeptical that Universal Basic Income can get rid of grinding poverty, since somehow humanity's 100-fold productivity increase (since the days of agriculture) didn't eliminate poverty.

But open sourcing, that's just sheer catastrophe. [...] wrong approach, the wrong ideal. [...] where if you could align it it would take time [...] not kill everyone.

But open sourcing, that's just sheer catastrophe. [...] wrong approach, the wrong ideal. [...] where if you could align it it would take time [...] not kill everyone.

the most likely result of building a superhumanly smart AI, under anything remotely like the current circumstances, is that literally everyone on Earth will die.

Make immediate multinational agreements to prevent the prohibited activities from moving elsewhere. [...] preventing AI extinction scenarios is considered a priority above preventing a [...] nuclear exchange

The moratorium on new large training runs needs to be indefinite and worldwide. There can be no exceptions, including for governments or militaries. If the policy starts with the U.S., then China needs to see that the U.S. is not seeking an advantage...

Many researchers steeped in these issues, including myself, expect that the most likely result of building a superhumanly smart AI, under anything remotely like the current circumstances, is that literally everyone on Earth will die. Not as in “maybe...

From our perspective, an AI will either be so slow as to be bottlenecked, or so fast as to be FOOM. [...] 'AI go FOOM'.