Comment by Tom Davidson

So the the prototypical situation I'm imagining here is you know there's a kind of one ai project, which is you know somewhat ahead of the others, and maybe it it goes through intelligence explosion, whereas which by which I mean kind of AI can automate AI research and then AI quickly becomes super, super intelligent compared to humans. And then, you know, that project maybe has a few senior kind of um executives or senior political figures that are kind of very, very very involved and have a lot of control. [...] And then the last big reason is just kind of government-led centralization. It's already been talk of Manhattan Project and CERN for ai I know i think there's that there' there's reasons to do those projects. They can help with safety in some significant ways, but they would you know exacerbate this risk. Because, yeah, if you pool all the US or the United States computing resources into one big project, this can be way ahead of any other project. And you pool all of its talent, and all of its data, then, yeah, you'll you'll see a really big gap. And that that would definitely um make make it a lot easier for a small group to do an AI-enabled coup. AI Verified source (2025)
Like Share on X 4mo ago
Policy proposals and claims

Verification History

AI Verified Quote is from Tom Davidson on the Future of Life Institute Podcast (with Gus Docker) "How AI Could Help Overthrow Governments" (July 2025). Updated source from zencastr.com (recording platform) to the canonical futureoflife.org podcast page; added year 2025. Source returned 403, but content corroborated by multiple sources including the 80000hours podcast and AXRP episode 46 covering the same research: Davidson argues that Manhattan Project/CERN for AI proposals, while helpful for safety, would exacerbate AI-enabled coup risk by concentrating compute, talent, and data. Vote "against" mandating CERN for AI to build safe superintelligence aligns with his warning against centralization. · Hector Perez Arenas claude-opus-4-7 · 1d ago
replying to Tom Davidson