AGI could quickly lead to superintelligence

Share this with your representatives, journalists and friends
Cast your vote:
Results (79 votes):
Total (79 votes)
For 68 (86%) Abstain 0 (0%) Against 11 (14%)
·
Quotes (71) Users (0)
  • Jacob Coxon
    AI safety researcher at Anthropic who publicly warned about risks from frontier AI development.
    votes For and says:
    Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives.
    AI Verified source (Sep 9, 2026)
    Like Comment Share on X added 9d ago
    Info
    Delegate
  • Dwarkesh Patel
    Technology journalist and host of the Dwarkesh Podcast, which features in-depth interviews on artificial intelligence, science, and technology.
    votes For and says:
    If, because of RSI, we got a jump as big as GPT-3 to a Mythos (i.e. 6 years of AI progress) within a single year of achieving AGI, then the thing we get there at the end of that year is definitively and wildly superhuman.
    AI Verified source (Aug 11, 2026)
    Like Comment Share on X added 6d ago
    Info
    Delegate
  • Craig A. Kaplan
    Founder of iQ Company and author of AI safety research on safe superintelligence.
    votes For and says:
    Artificial General Intelligence, or AGI, is AI that can do any intellectual task as well as, or better than, the average human. A Personalized SuperIntelligence, or PSI, does not stop there. Because PSI is self-improving, it will become exponentially...
    more AI Verified source (Aug 10, 2026)
    Like Comment Share on X added 7d ago
    Info
    Delegate
  • votes For and says:
    That means that a self-improving AI system running on a fraction of the world’s compute could conceivably command more effective compute and intelligence, and therefore a greater balance of power than everyone else combined and become the singular su...
    more AI Verified source (Aug 10, 2026)
    Like Comment Share on X added 11d ago
    Info
    Delegate
  • votes For and says:
    There are a lot of potentially good outcomes from AI. I think the most likely outcomes are good. But the risk of bad and even catastrophic outcomes is high enough to be worth taking seriously. We should actively build safety mechanisms in case we nee...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Austin Han
    Researcher at OpenAI; commenter on the July 2026 Pacing the Frontier statement.
    votes For and says:
    Building the mechanisms to coordinate, collaborate, and when necessary, deliberate the pace of AI development will be one of the most important, and delicate, challenges we now face.
    AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • votes For and says:
    Unless we change companies' default incentives, I worry about a race on AI R&D going much faster than is ideal for safety. International coordination via the government is necessary; we need to have a real slowdown option.
    AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Alex Cloud
    Member of Technical Staff at Anthropic; signatory to the July 2026 Pacing the Frontier statement.
    votes For and says:
    I expect this trend to continue, possibly to a point where AI development is dramatically faster than today and involves almost no human input. I don’t think the world is ready for this possibility.
    AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Michael Mulet
    Anthropic employee; commenter on the July 2026 Pacing the Frontier statement.
    votes For and says:
    Whatever comes of this stays limited in scope rather than growing into something expansive or excessive. Still, the capabilities of this kind of AI should be taken seriously, and they warrant measured action.
    AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Nicholas Joseph
    Member of Technical Staff at Anthropic leading pretraining.
    votes For and says:
    Every month, more work is done by the models themselves: infrastructure implementation, code optimization, and experiment design and analysis. This has drastically altered how we work and significantly increased our rate of progress. I’m not sure if ...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • votes For and says:
    Misalignment is a still-unsolved technical problem, as the Hugging Face incident made clear, and it will only be amplified by more intelligent models. Solving the alignment problem may require a global slowdown of the frontier, including internal dep...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • votes For and says:
    Many researchers also consider recursive self-improvement (RSI) plausible within the next few years, accelerating progress in a way that could outpace our ability to understand and govern these systems.
    AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Shantanu Jain
    Member of Technical Staff at OpenAI; artificial-intelligence researcher.
    votes For and says:
    In the span of four years, we have gone from people having their first experience of an AI that could understand language, to AI that is performing superhuman feats of software engineering, making frontier math breakthroughs, and accelerating scienti...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Darshan Kalola
    Applied AI Engineer at Anthropic; commenter on the July 2026 Pacing the Frontier statement.
    votes For and says:
    There is intense commercial pressure to win the AI race. Ensuring safety often requires making tradeoffs that hurt commercial interests. Therefore, I think its a good idea for better coordination between labs so we can build this technology safely, a...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Mike Heaton
    Member of Technical Staff in Audio at OpenAI; commenter on the July 2026 Pacing the Frontier statement.
    votes For and says:
    We believe AI will do, and is doing, great things for the world. We are already seeing instances where pushing research maximally fast creates serious issues, and it is possible that these will get much more severe. Right now, competitive dynamics me...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Elie Bakouch
    AI researcher at Prime Intellect; commenter on the July 2026 Pacing the Frontier statement.
    votes For and says:
    Supportive of this, but we should be careful not to use RSI narratives to create a regulatory moat. These risks need to be properly quantified, more openly, not derived from big labs narratives only!
    AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Thomas Wolf
    Co-founder and Chief Science Officer of Hugging Face.
    votes For and says:
    AI progress has already out-paced society’s capabilities to handle it, let’s be careful for it not to out-pace its builder’s capabilities to control it. The journey is as important as the destination.
    AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Ben Nowak
    Principal Engineer at Meta; commenter on the July 2026 Pacing the Frontier statement.
    votes For and says:
    Responsible AI development requires more than capable models. It requires independent monitoring, containment, clear limits on authority, and mechanisms for coordinated pacing if automated research begins to outrun those controls. Building that capac...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Andrew Locke
    Lead Engineer for Federal at Cognition; commenter on the July 2026 Pacing the Frontier statement.
    votes For and says:
    The pace of frontier AI development is currently outstripping our ability to ensure its safety, governance, and alignment with human values. We are racing to build systems with unprecedented capability without first building the guardrails, evaluatio...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Leo He
    Research Engineer at Google; commenter on the July 2026 Pacing the Frontier statement.
    votes For and says:
    As someone who works on recursive self-improvement and automated evaluation, I sign this because the diagnosis is right and the ask is refreshingly humble: pace, not pause. The phrase that matters is "automating AI research": that's the point where s...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Felix Juefei Xu
    Research Scientist at Google working on AI safety, robustness, evaluation, and responsible model development.
    votes For and says:
    Having worked both on AI safety topics—including robustness, evaluation, and responsible model development—and on frontier multimodal AI systems, I have seen firsthand how quickly capabilities can advance and how difficult it can be for our understan...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Dee Cattle
    Research Strategist for Ethics & Safety at Google; AI safety and governance researcher.
    votes For and says:
    Humanity is not sufficiently prepared for the impacts of advanced AI in psychological, social, environmental, labour market, and military domains. With an inflection point in recursive AI self-improvement forecasted to be just around the corner, lead...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • votes For and says:
    I have worked in AI for a decade. Every few months in the last years, I have found myself surprised again and again at how rapidly the technology advances, no matter how often I update my predictions. AI may end up progressing far more quickly than s...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • votes For and says:
    As Melvin Kranzberg wrote, technology is neither good nor bad; nor is it neutral. Achieving societal benefit depends on understanding the interdependent ways in which many humans use advanced AI systems in concert, understanding that takes time to ac...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • votes For and says:
    Like splitting the atom, AI holds the potential for both immense benefit and immense risk. The world should take the time to do this right.
    AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Matthew Rahtz
    Staff Research Engineer at Google; AI capability-evaluation researcher.
    votes For and says:
    Even after 3 years working on AI capability evaluations, the recent pace of progress has been a shock. To avoid catastrophic harms from AGI, we need much, much better coordination.
    AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Leo Gao
    Member of Technical Staff at OpenAI; AI researcher.
    votes For and says:
    The world is locked in a deadly race towards an intelligence explosion, where AI’s ability to create better AIs reaches a critical point, just like a runaway nuclear chain reaction. Going slower would give us much-needed time to make it go well, but ...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
  • Ilya Sutskever
    AI researcher, co-founder and former former chief scientist at OpenAI
    votes For and says:
    Future AI will be extraordinarily powerful compared to anything that exists today, and dealing with this future power will require unprecedented measures, such as the ones described here. The problem statement is real. This works only if it is done i...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 1mo ago
    Info
    Delegate
Loading more opinions...
Loading more opinions...
Loading more opinions...