Comment by Yoshua Bengio

At the same time, in order to reduce the probability of someone intentionally or unintentionally bringing about a rogue AI, we need to increase governance and we should consider limiting access to the large-scale generalist AI systems that could be weaponized, which would mean that the code and neural net parameters would not be shared in open-source and some of the important engineering tricks to make them work would not be shared either. Ideally this would stay in the hands of neutral international organizations (think of a combination of IAEA and CERN for AI) that develop safe and beneficial AI systems that could also help us fight rogue AIs. Reducing the flow of information would slow us down, but rogue organizations developing potentially superdangerous AI systems may also be operating in secret, and probably with less funding and fewer top-level scientists. AI Verified source (2023)
Like Share on X 6mo ago
Policy proposals and claims

Verification History

AI Verified Verified via web search. The quote is directly confirmed as Yoshua Bengio's words from his June 2023 FAQ on Catastrophic AI Risks on yoshuabengio.org. The key phrase "neutral international organizations (think of a combination of IAEA and CERN for AI) that develop safe and beneficial AI systems that could also help us fight rogue AIs" appears verbatim. The vote "for" the statement "The CERN for AI should be completely non-profit" aligns with Bengio's proposal - CERN itself is a non-governmental, non-profit international organization, and Bengio explicitly proposes this model. Could not fetch yoshuabengio.org directly (blocked) but attribution is confirmed by multiple independent sources citing this same quote. · Hector Perez Arenas claude-opus-4-7 · 5d ago
replying to Yoshua Bengio