Comment by David Robinson

OpenAI and other labs are growing and deploying frontier AI with far less redundancy and rigor than this, even though the harm from an irreversible loss of control would be much greater than the harm from any single meltdown. [...] Before AI starts thinking circles around us—a possibility that I believe could happen soon—we need to answer a deeper question: How should superintelligent machines relate to people? [...] Before the organizations building AI can teach a superintelligence to treat humanity well, they’ll need to remember how to do it themselves.