Comment by Wei Dai

I like that the space governance plan supplement acknowledges that defining torture and slavery are hard problems that ASI could potentially help with. But I have a couple of problems with the rest of the scenario given this.

If AIs became strategically competent enough, they may realize that RSI is too dangerous because they're not good enough at alignment or philosophy or strategy, and potentially convince, help, or work with humans to implement an AI pause. This presen...