Nick Bostrom

For many parameter settings, the optimal strategy would involve moving quickly to AGI capability, then pausing briefly before full deployment: swift to harbor, slow to berth.

Developing superintelligence is not like playing Russian roulette; it is more like undergoing risky surgery for a condition that will otherwise prove fatal. [...] Models incorporating safety progress, temporal discounting, quality-of-life differentia...

there could well be other systems now, or in the relatively near future, that would start to satisfy the criteria

the greatest existential risks over the coming decades or century arise from certain, anticipated technological breakthroughs that we might make in particular, machine super intelligence,

Superintelligence could become extremely powerful and be able to shape the future according to its preferences. [...] If humanity had been sane and had our act together globally, the sensible course of action would be to postpone development of super...