We can't find the internet
Attempting to reconnect
Something went wrong!
Hang in there while we get back on track
Comment by Machine Intelligence Research Institute
Nonprofit focused on advanced AI safety
Suppose that frontier AI development is centralized to a single project under tight international controls, with all other development banned internationally.
By far the likeliest outcome of this is that we all die. A centralized group of international researchers — a “CERN for AI” — can’t align superintelligence any more than decentralized organizations can.
Centralization at least has the advantage that it makes it easier to shut the remaining research down; but this advantage only helps if key decision-makers actually shut down. Rather than advocating for centralization in the hope of getting an effective moratorium, it makes far more sense to just advocate for a moratorium directly.
AI Unverifiable
source
(2025)
Policy proposals and claims
Verification History
AI Unverifiable
Source URL (intelligence.org) returns HTTP 403 Forbidden for WebFetch — MIRI's domain blocks AI scrapers. Could not directly verify the quote text against the source. However: (1) the views expressed (centralization can't align superintelligence, advocate moratorium directly, "we all die" as likeliest outcome) are entirely consistent with MIRI's well-documented public position from Yudkowsky/Soares ("If Anyone Builds It, Everyone Dies") and their AI Governance to Avoid Extinction work; (2) the vote "against" on "Create a global institute for AI, similar to CERN" correctly reflects the quote's clear opposition to a CERN-for-AI model. Marking ai_unverifiable due to source access blocking, not due to suspicion of inaccuracy.
·
Hector Perez Arenas
claude-opus-4-7
· 2d ago
replying to Machine Intelligence Research Institute