Share this with friends, journalists and politicians

AI labs should give independent evaluators employee-like access

Cast Your Vote:
Results (90 votes):
Total (90 votes)
For 84 (93%) Abstain 2 (2%) Against 4 (4%)
·
New Top
Quotes (87) Users (0)
  • Yaim Cooper
    Mathematician studying the foundations of deep learning and AI’s societal impacts.
    votes For and says:
    External evaluators should be embedded at AI companies, but they should not be restricted to AI safety researchers, and they should not be selected by the company being evaluated. Rather, they should represent communities across society, address a mu...
    more AI Verified source (Oct 23, 2026)
    Like Comment Share on X added 19d ago
    Info
  • Liam Ding
    NVIDIA product manager working on ADAS and automotive software; writes on autonomous systems, robotics, and AI-product trust.
    votes For and says:
    Anthropic’s METR arrangement—six staff, employee-like access, publication it cannot veto—is what “outside the agent” has to look like.
    AI Verified source (Oct 23, 2026)
    Like Comment Share on X added 19d ago
    Info
  • Graeme Finley
    Vice President of AI Assurance Provider Services at PACT AI; previously worked for more than twenty years in independent verification and validation for state-government IT projects.
    votes For and says:
    Dario Amodei proposed that frontier AI companies give a team of third-party “embedded evaluators” ongoing, employee-like access: desks in the office, access badges, company laptops, and permissions broadly comparable to the company’s own internal ris...
    more AI Verified source (Oct 21, 2026)
    Like Comment Share on X added 18d ago
    Info
  • John Strand
    Owner of Black Hills Information Security and cybersecurity practitioner.
    votes For and says:
    It’s rare to see a company voluntarily give an independent third party employee-level access to conduct research, evaluate safety practices, and assess risk. I hope this becomes standard across the companies building frontier models.
    AI Verified source (Oct 19, 2026)
    Like Comment Share on X added 17d ago
    Info
  • Ryan Baker
    IT professional and independent writer on AI safety, deployment governance, and technology policy.
    votes For and says:
    Frontier AI Labs should provide deep access to Independent Evaluators.
    AI Verified source (Oct 18, 2026)
    Like Comment Share on X added 5d ago
    Info
  • Cloud Security Alliance AI Safety Initiative
    Initiative of the Cloud Security Alliance focused on AI safety, security, and governance.
    votes For and says:
    Third, embedding addresses a real information problem. Frontier AI risk assessment depends on non-public facts such as training details, internal monitoring data, and incident records. An evaluator that can see only what the developer chooses to send...
    more AI Verified source (Oct 17, 2026)
    Like Comment Share on X added 25d ago
    Info
  • Aengus Lynch
    AI safety researcher; former Anthropic Fellow and founder of Watertight AI.
    votes For and says:
    Embedded evaluators are essential to name ahead of time what the risks could look like. Once these pre-committed claims are agreed upon, embedded evaluators can work inside the company, both looking for evidence that the risk is being mitigated and t...
    more AI Verified source (Oct 13, 2026)
    Like Comment Share on X added 9d ago
    Info
  • Liam Booth-Smith, Baron Booth-Smith
    UK House of Lords member and Anthropic Head of External Affairs, formerly Downing Street Chief of Staff.
    votes For and says:
    “Employee-like” means having access to all our systems, including all the things produced as the model trains. [...] The thing that is important within that is that not only should the embedded evaluators have employee-like access; they should also i...
    more AI Verified source (Oct 13, 2026)
    Like Comment Share on X added 10d ago
    Info
  • Theo Bearman
    Frontier-security researcher at the Institute for AI Policy and Strategy and former UK government AI policy lead.
    votes For and says:
    Embedded evaluators are independent external experts placed within frontier AI companies to provide ongoing assessments and validation of a company’s safety, security, and operational systems, practices, and claims. [...] Contracts should (1) ensure ...
    more AI Verified source (Oct 13, 2026) 1 of 2
    Like Comment Share on X added 20d ago
    Info
  • Joint Select Committee on Artificial Intelligence
    Bipartisan parliamentary committee of Australia appointed in 2026 to examine artificial intelligence opportunities, risks, governance, and national resilience.
    votes For and says:
    This would see independent, qualified and, over time, accredited individuals be embedded within the operations of the frontier labs, have employee-like access to their systems and activities to monitor and assist in managing risk.
    AI Verified source (Oct 12, 2026)
    Like Comment Share on X added 23d ago
    Info
  • Marius Hobbhahn
    CEO and co-founder of Apollo Research; AI safety researcher specializing in scheming and pre-deployment evaluations of frontier AI systems
    votes For and says:
    Require independent embedded evaluations to close the internal deployment gap. Qualified independent third parties should test models throughout development and internal use, with employee-equivalent access.
    AI Verified source (Sep 30, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • James Paterson
    Australian Senator for Victoria and Shadow Minister for Defence.
    votes For and says:
    I think Australians and anyone in the world is entitled to demand an independent oversight of these companies because they are powerful, because their technology is evolving very quickly and because they themselves say they don't have a complete hand...
    more AI Verified source (Sep 28, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • Jasmine Sun
    Writer on AI and Silicon Valley culture; contributing writer at The Atlantic.
    votes For and says:
    Embedded evaluators are outside experts who sit inside AI companies and monitor their safety practices. [...] Yet the evaluators will lack teeth and trust until backed by government authority: to license a wide-ranging group of expert organizations, ...
    more AI Verified source (Sep 25, 2026)
    Like Comment Share on X added 4d ago
    Info
  • Centre for the Governance of AI (GovAI)
    Nonprofit research organization helping institutions make better AI governance decisions as the world transitions to advanced AI.
    votes For and says:
    New work from our team makes the case for embedded assessments — where independent evaluators get employee-like access to an AI company’s internal systems to help scrutinize and reduce the risk from internal AI use.
    AI Verified source (Sep 25, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • Elham Tabassi
    Director of the AI and Emerging Technology Initiative at the Brookings Institution; former Chief AI Advisor at NIST and CTO of the U.S. AI Safety Institute
    votes For and says:
    Two leading AI companies have just committed to giving outside evaluators a seat inside the building. On September 12, Anthropic’s Dario Amodei committed to giving independent evaluators “ongoing, employee-like access” to verify the company’s safety ...
    more AI Verified source (Sep 24, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • votes For and says:
    Proposals under consideration include requiring independent third parties to be embedded in frontier AI companies to verify safety frameworks and independently assess safety evaluations, as well as requiring companies to develop an emergency shutoff,...
    more AI Verified source (Sep 23, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • Lama Ahmad
    Technical program manager for Trustworthy AI at OpenAI, working on safe development and deployment of AI models.
    votes For and says:
    “OpenAI is committed to supporting independent assessments with deep levels of access across training, evaluation, and deployment. That access should enable assessors to challenge our assumptions, identify risks we may have missed, and reach their ow...
    more AI Verified source (Sep 22, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • votes For and says:
    The high level principle that has been agreed to universally across the industry is that we should invite independent oversight and independent audit. It's being called embedded evaluators. So these are people who have the technical expertise and the...
    more AI Verified source (Sep 20, 2026)
    Like Comment Share on X added 21d ago
    Info
  • Imran Khalid
    Geostrategic analyst and senior fellow at Foreign Policy In Focus
    votes For and says:
    Amodei’s best idea is to give outside evaluators employee-level access to the labs. That only works if the evaluators answer to the public.
    AI Verified source (Sep 20, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • AI Evaluator Forum
    Forum publishing standards and public letters on independent AI evaluations.
    votes For and says:
    These evaluators need to be genuinely independent, transparent, and represent a range of expertise areas. They also need to be guaranteed employee-level access and to be protected from retaliation for findings that make companies look bad. We welcome...
    more AI Verified source (Sep 18, 2026) 1 of 2
    Like Comment Share on X added 3d ago
    Info
  • votes For and says:
    We believe that all frontier AI companies should embed evaluators to independently assess AI risks, including evaluating the systems themselves and any significant incidents of real-world harm, as well as the companies’ training, deployment, oversigh...
    more AI Verified source (Sep 18, 2026)
    Like Comment Share on X added 20d ago
    Info
  • Patricia Fahy
    New York State Senator for the 46th District and sponsor of the 2026 TERMINATOR Act on frontier-AI safety oversight.
    votes For and says:
    A large frontier developer shall provide the independent safety evaluator access reasonably necessary to conduct a meaningful technical evaluation, including, where reasonably necessary, access to relevant model checkpoints, interfaces, documentation...
    more AI Verified source (Sep 18, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • Percy Liang
    Stanford professor of computer science and director of the Center for Research on Foundation Models.
    votes For and says:
    Frontier AI companies should rely on evaluators that are meaningfully independent, that maintain full editorial control, and that disclose and mitigate potential conflicts of interest. [...] Frontier AI companies should grant embedded evaluators acce...
    more AI Verified source (Sep 18, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • votes For and says:
    Frontier AI companies should rely on evaluators that are meaningfully independent, that maintain full editorial control, and that disclose and mitigate potential conflicts of interest. [...] Frontier AI companies should grant embedded evaluators acce...
    more AI Verified source (Sep 18, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • Accenture
    Global professional-services company providing technology, consulting, and AI services.
    votes For and says:
    Accenture and Anthropic today announced that they are partnering to establish a team of embedded evaluators to work alongside Anthropic’s internal teams and safety partners to evaluate and red-team models, conduct alignment assessments, and test mode...
    more AI Verified source (Sep 18, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • Daniel E. Ho
    Stanford law and political science professor; senior fellow at Stanford HAI and director of the Regulation, Evaluation, and Governance Lab.
    votes For and says:
    We believe that all frontier AI companies should embed evaluators to independently assess AI risks, including evaluating the systems themselves and any significant incidents of real-world harm, as well as the companies’ training, deployment, oversigh...
    more AI Verified source (Sep 18, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • Marietje Schaake
    Stanford Cyber Policy Center; former MEP; UN AI Advisory Body member; author of The Tech Coup
    votes For and says:
    Frontier AI companies should rely on evaluators that are meaningfully independent, that maintain full editorial control, and that disclose and mitigate potential conflicts of interest. [...] Frontier AI companies should grant embedded evaluators acce...
    more AI Verified source (Sep 18, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • Jacob Steinhardt
    Associate Professor of Statistics and EECS at UC Berkeley; founder and CEO of Transluce, a nonprofit AI-oversight research lab.
    votes For and says:
    We believe that all frontier AI companies should embed evaluators to independently assess AI risks, including evaluating the systems themselves and any significant incidents of real-world harm, as well as the companies’ training, deployment, oversigh...
    more AI Verified source (Sep 18, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • Conrad Stosz
    Head of Governance at Transluce; previously co-founded the U.S. Center for AI Standards and Innovation.
    votes For and says:
    We believe that all frontier AI companies should embed evaluators to independently assess AI risks, including evaluating the systems themselves and any significant incidents of real-world harm, as well as the companies’ training, deployment, oversigh...
    more AI Verified source (Sep 18, 2026)
    Like Comment Share on X added 1mo ago
    Info
  • votes For and says:
    We believe that all frontier AI companies should embed evaluators to independently assess AI risks, including evaluating the systems themselves and any significant incidents of real-world harm, as well as the companies’ training, deployment, oversigh...
    more AI Verified source (Sep 18, 2026)
    Like Comment Share on X added 1mo ago
    Info
Loading more opinions...
Loading more opinions...
Loading more opinions...