Comment by Will MacAskill

AGI preparedness is not just about ensuring that advanced AI systems are aligned: we should be preparing, now, for the disorienting range of developments an intelligence explosion would bring — including new weapons of mass destruction, AI-enabled autocracies, races to grab offworld resources, and digital beings worthy of moral consideration. These challenges cannot always be delegated to future AI systems.