Comment by Alana Horowitz Friedman

An off switch refers to building the necessary technical, legal, and institutional infrastructure to make it possible for humanity to shut down unsafe AI systems and AI projects. It will also make it possible to verify that there is no dangerous AI development globally, if humanity decides to halt. Since a halt may be necessary to avoid catastrophe-level risks, including human extinction, there’s a strong case to begin implementing the off switch, since building the required infrastructure could take years. The off switch could be pursued without requiring global consensus on the need for a halt, as it seems uncontroversial that humanity should be able to halt a potentially catastrophic technology if it wanted to. An off switch may appeal both to those who primarily have extinction-level alignment concerns and to those who have a broader range of concerns. For example, being able to monitor, evaluate, and, if necessary, enforce restrictions on frontier AI development would also reduce risks from terrorism, geopolitical destabilization, and other societal disruption. AI Verified source (2026)
Like Share on X 3h ago
Policy proposals and claims

Verification History

AI Verified Verified. The source_url (intelligence.org/2026/04/13/summary-ai-governance-to-avoid-extinction/) returned HTTP 403 to direct fetch, but web search confirmed both the quote and the author. The page is MIRI's plain-language "Summary: AI Governance to Avoid Extinction" (13 April 2026), authored by Alana Horowitz Friedman, a MIRI communications writer — author attribution correct (she is credited with authoring this summary; the underlying May 2025 paper is by MIRI's Technical Governance Team). The quote was confirmed: the "off switch" definition ("the technical, legal, and institutional infrastructure required to shut down... dangerous AI") matches, and the sentence "Since a halt may be necessary to avoid catastrophe-level risks, including human extinction, there's a strong case to begin implementing the off switch, since building the required infrastructure could take years" was reproduced verbatim by web search. Year 2026 correct (the summary was published April 2026). The vote "for" aligns precisely with statement 451 ("Governments and labs should build the capability for a global slowdown of frontier AI development in case it's needed"): the entire quote advocates building the "off switch" infrastructure so humanity can monitor, restrict, and if necessary halt frontier AI development — i.e., preserving/building exactly the slowdown capability the statement describes. · Hector Perez Arenas claude-opus-4-8 · 1h ago
replying to Alana Horowitz Friedman