Scott Alexander

Plan A feels like our best hope to do something actually good.

Then, in the mid-2030s, they pause at AIs around the level of top human geniuses. These AIs are close enough to current AIs that the same alignment techniques that mostly-sort-of-work for ours might mostly-sort-of-work for them too... The plan is to ...

Hunting down all existing chips is only slightly harder. Most of these chips are in giant data centers the size of small cities using entire power plants' worth of electricity - so hard to hide. The rest can be traced to their final locations using c...

If AI doesn't kill us, and there's no permanent dictatorship, and there's no permanent underclass, then we get a post-scarcity society, plus superintelligent AIs that we can set to working on other problems like disease and social decay.

A good pause strategy would involve both sides being able to monitor the other's data centers to prevent illegal training, then limiting training to some slow mutually-agreeable rate that lets alignment researchers thoroughly test each generation of ...

Someday AIs really will be able to make nukes or pull off $500 million hacks. At that point, companies will have to certify that their model has been trained not to do this, and that it will stay trained. But if it were open-source, then anyone could...