Comment by Geoffrey Irving

If you’re doing a very dangerous thing, you should just slow down. The AI companies are overplaying the extent to which this is a pure coordination problem. They could just stop unilaterally.

I think that could work. I don’t think we have a strong argument that the pragmatic mixture of approaches will get all the way there, but it just seems very dicey, and our understanding of the dynamics involved is very weak.

Now. My take is that if we were to carefully analyse this question of exactly when we should slow down, it would be a while ago in the past, because we’re just too close to this crazy future. Trying to be super precise about exactly when in the futur...