Share this with friends, journalists and politicians

Require open source AI models to include safety benchmarks in release notes

Cast Your Vote:
Results (48 votes):
Total (48 votes)
For 39 (81%) Abstain 0 (0%) Against 9 (19%)
·
New Top
Quotes (47) Users (0)
  • Kanupriya Yakhmi
    PhD student at the University of the Cumberlands and author on AI safety documentation and governance.
    votes For and says:
    The way to get there is a shared machine-readable format. I call it a Safety Framework Card.
    AI Verified source (Jul 24, 2026)
    Like Comment Share on X added 3mo ago
    Info
  • Thinking Machines
    AI model developer whose Inkling model card reports pre-release safety evaluations and benchmarks.
    votes For and says:
    Inkling reports reasoning, agentic, factuality, chat, vision, audio, and safety benchmark results at effort=0.99.
    AI Verified source (Jul 14, 2026)
    Like Comment Share on X added 4mo ago
    Info
  • votes For and says:
    Now we need to open that with more open benchmarks, verification, independent testing, making sure that models reflect linguistic diversity, open science, and technical standards.
    AI Verified source (Jul 7, 2026)
    Like Comment Share on X added 4mo ago
    Info
  • Independent International Scientific Panel on Artificial Intelligence
    United Nations independent scientific panel that issued its July 2026 preliminary report on artificial intelligence.
    votes For and says:
    Researchers also consistently advocate for rigorous measurement and evaluation protocols to assess a model’s safety prior to publication. International bodies like the United Nations can play a critical role in coordinating global standards, ensuring...
    more AI Verified source (Jul 2026)
    Like Comment Share on X added 4mo ago
    Info
  • votes For and says:
    DiffusionGemma underwent careful scrutiny, input data pre-processing, and post-training evaluations as reported in this card to help mitigate the risk of these biases.
    AI Verified source (Jun 10, 2026)
    Like Comment Share on X added 2mo ago
    Info
  • votes For and says:
    Developers should test their models against each of the four Enumerated Risk categories and publish a summary of the results.
    AI Verified source (Jun 2026)
    Like Comment Share on X added 3mo ago
    Info
  • Hoki Kim
    Professor at Chung-Ang University researching AI governance and open-weight foundation-model policy.
    votes For and says:
    The model card is restructured from prose README into a machine-readable structured document organized around three principles: (1) heritage transparency — full disclosure of training data, base model, and alignment lineage; (2) alignment provenance ...
    more AI Verified source (May 7, 2026)
    Like Comment Share on X added 4mo ago
    Info
  • Wojciech Zaremba
    Head of AI Resilience at the OpenAI Foundation; OpenAI co-founder.
    votes For and says:
    As these tools become part of everyday life, it's important that they're designed to be safe, trustworthy, and appropriate for different stages of development. That's why independent evaluation and public accountability matter.
    AI Verified source (May 5, 2026)
    Like Comment Share on X added 3mo ago
    Info
  • Vivek Murthy
    Former U.S. Surgeon General (19th and 21st); physician and public health advocate
    votes For and says:
    We urgently need policies and institutions that will demand transparency, allow for independent safety evaluations, and enforce accountability. The well-being of the next generation is at stake.
    AI Verified source (May 5, 2026)
    Like Comment Share on X added 3mo ago
    Info
  • votes For and says:
    The Youth AI Safety Institute's role is to set a high bar: rigorous standards, independent testing, and transparent results that raise the bar for everyone.
    AI Verified source (May 5, 2026)
    Like Comment Share on X added 3mo ago
    Info
  • votes For and says:
    It will establish safety standards, build open-source evaluations that AI developers can run against their models, independently test AI products, and publish the results to provide transparency and accountability.
    AI Verified source (May 5, 2026)
    Like Comment Share on X added 3mo ago
    Info
  • Helen Toner
    Interim Executive Director at Georgetown University's Center for Security and Emerging Technology (CSET); former OpenAI board member
    votes For and says:
    Results of testing for AI models’ capabilities and risks. A lack of clear, up-to-date information about what the world’s best AI systems are capable of puts the U.S. government at a huge disadvantage in understanding how the AI frontier is progressin...
    more AI Verified source (Apr 22, 2026)
    Like Comment Share on X added 3mo ago
    Info
  • Liam Romanis
    Independent cybersecurity and AI security consultant; author of a draft model-card security standard.
    votes For and says:
    This standard applies to any machine learning model published to a public model repository with a downloadable model card or README. [...] MCSS-1 (Baseline) | Any publicly published model | All HuggingFace models, open-source releases [...] Safety ev...
    more AI Verified source (Apr 20, 2026)
    Like Comment Share on X added 14d ago
    Info
  • Marisol Vega
    Writer on AI governance and dual-use risks from open-weight model releases.
    votes For and says:
    A more tractable near-term proposal is mandatory pre-release evaluation against a defined set of uplift benchmarks, particularly for chemical and biological capability, with results published before weights ship.
    AI Verified source (Feb 19, 2026)
    Like Comment Share on X added 3mo ago
    Info
  • votes For and says:
    Develop and publish monitorability evaluations. Standardized evaluations and metrics can improve assessments for how monitorable an AI model’s reasoning process is. These tests would measure the clarity, coherence, and faithfulness of a model’s Chain...
    more AI Verified source (Jan 27, 2026)
    Like Comment Share on X added 3mo ago
    Info
  • votes For and says:
    In the US, we support state efforts to align around common frameworks such as California SB 53, the New York RAISE Act, and Illinois SB 315, which emphasize transparency, public reporting around catastrophic-risk evaluations and safety incidents, whi...
    more AI Verified source (2026)
    Like Comment Share on X added 3mo ago
    Info
  • votes For and says:
    Policy and safeguards must evolve just as swiftly [...] requiring safety assurances for powerful open releases before the window for meaningful intervention closes.
    AI Verified source (2026)
    Like Comment Share on X added 8mo ago
    Info
  • votes For and says:
    In November 2024, we authored a paper addressing the rapidly evolving ecosystem of publicly available AI models and their potential implications for security and safety. In this paper we proposed standardization of model cards and extensions to inclu...
    more AI Verified source (Sep 3, 2025)
    Like Comment Share on X added 9mo ago
    Info
  • votes For and says:
    Class III (Open Model): The entry point for openness. This involves the partial release of components which typically includes the model architecture, final model weights, and basic documentation, like a technical report, evaluation results, a model ...
    more AI Verified source (Jul 15, 2025)
    Like Comment Share on X added 9mo ago
    Info
  • votes For and says:
    platforms that host libraries of open-source AI models to ensure that models are uploaded with appropriate system and safety information
    AI Verified source (2025) 1 of 2
    Like Comment Share on X added 9mo ago
    Info
  • votes For and says:
    Select models where [...] performance on evaluation and red-teaming efforts are disclosed, over models that don’t – model cards can help with providing this information;
    AI Verified source (Nov 2024)
    Like Comment Share on X added 9mo ago
    Info
  • votes For and says:
    For models with risk above the lowest level, most evaluation results and methods should be public, including any performed mitigations.
    AI Verified source (Mar 5, 2024)
    Like Comment Share on X added 9mo ago
    Info
  • votes For and says:
    Unsecured “open-source” AI systems pose a massive series of threats [...]. They deserve no exemptions and should be regulated just like other high-risk AI systems.
    AI Verified source (Dec 4, 2023)
    Like Comment Share on X added 9mo ago
    Info
  • votes For and says:
    policymakers and regulators have no choice but to deal with both open and closed-source models. [...] If independent testing were done and results on an intelligible scale were published, I think that would encourage constructive competition.
    AI Verified source (Nov 8, 2023)
    Like Comment Share on X added 9mo ago
    Info
  • votes For and says:
    For pre-deployment risk assessments for open source, [...] models, [...] are released with a model card. Model cards [...] will generally come with a set of evaluations.
    AI Verified source (Nov 8, 2023)
    Like Comment Share on X added 9mo ago
    Info
Loading more opinions...
Loading more opinions...
Loading more opinions...