I worry about it. Sometimes, I think we’re going to wind up building better AI at some point no matter what I say and that we should prepare for what we’re going to do about it. I think that the concerns with over-empowered, mediocre AI are pretty serious and need to be dealt with no matter what. I signed that letter on a pause. I don’t expect that it’s going to happen. But I think that we as a society should be considering these things. I think we should be considering them even in conjunction with our competitors. But the geopolitical reality is probably that people will not. We have to prepare for that contingency as well. Sooner or later, we will get to artificial general intelligence and we should be figuring out what we’re going to do when we get there. (2023) source Unverified