AI labs should conduct risk assessments before high-stakes internal deployment of frontier models

Key insights

Across company policies, think-tank proposals, and legislative text, internal deployment is treated as a distinct risk setting rather than a private exception to safety review.
Many proposals use the same sequence for internal-use decisions: define risk thresholds, assess the model, apply mitigations, and review the results before deployment.
Several quotes frame the main regulatory gap as the period when frontier models are used inside labs or by trusted partners before public release, especially when guardrails are weaker or capabilities are still experimental.
The quotes differ less on the need for assessment than on the mechanism, ranging from internal decision gates and public frameworks to third-party evaluations, confidential reporting, and government access.
A recurring nuance is that pre-deployment checks alone may be insufficient, with some sources calling for continuous or trigger-based reassessment once internal deployment begins.

Arguments for

Internal deployment risk gap

Proponents argue that focusing only on public release leaves a major gap because frontier systems are often used internally first, sometimes with experimental capabilities or fewer guardrails. They say dangerous capability thresholds can be reached inside labs, making internal deployment a setting where catastrophic or under-scrutinized risks may emerge.

The primary goal of such regulation is to ensure that frontier models meet stringent safety standards before they are launched on the public market. But this would not address the conditions that triggered the recent hacks: namely, when developers and their trusted partners deplo…

Amos Toh · Oct 5, 2026 · full quote
Risk management standards emphasise that such decisions should follow a continuous and iterative process of risk evaluation and analysis, including reassessment after mitigations are implemented. [...] Because the most cutting-edge AI systems are often deployed internally first, …

Oxford Martin AI Governance Initiative · Feb 24, 2026 · full quote
To promote responsible frontier innovation, federal frontier governance should cover AI used internally by a developer in addition to any public or external offerings; there is already evidence that dangerous capability thresholds can be reached by internally deployed frontier mo…

Americans for Responsible Innovation · full quote
Most importantly, third-party evaluations triggered by public deployments are not designed to cover risks from internal use within the developer itself. [...] We believe that periodic third-party assessment of risks from developers’ internal use of AI should be adopted throughout…

METR · May 19, 2026 · full quote
Risk management within AI companies is crucial for internal deployments of frontier AI systems for AI R&D specifically. [...] Further work is needed to develop best practices for risk management that explicitly cover the internal deployment setting, implement these best practices…

Center for Security and Emerging Technology · 2026 · full quote

Early pre-deployment review

Supporters say risk assessment should come before broad or high-stakes internal use rather than waiting for external launch. Several company policies describe mandatory review gates for internal rollout and apply the same or similar capability thresholds and safeguards used for pre-release deployment.

The mainstream take is that an AI lab should assess risk before deploying a new model externally. But I think risk assessment should come way earlier in the model lifecycle. Compare the situation with dangerous bio. We wouldn't find it acceptable for a virology lab to synthesize …

Miles Kodama · Sep 14, 2026 · full quote
Internal use: The same systemic-risk assessment applies to internal use of frontier models, including research, operational systems, and internal products. Internal deployment is assessed against the same capability thresholds and safeguards as pre-release deployment.

Reflection AI · Oct 8, 2026 · full quote
We have strengthened monitoring, alignment, and security safeguards across the model-development lifecycle, including stronger isolation for frontier research workloads, expanded monitoring of model behavior during tool-enabled training and evaluations, and clearer rules for when…

Chris Lehane · Sep 9, 2026 · full quote
Before approving a new model for easy or broad internal use (e.g., making the model available via our most-used internal tools), we conduct a pre-deployment review process.

Anthropic · 2026 · full quote
Pre-deployment reviews include assessing benchmark results (e.g., WMDP scores) and mitigation effectiveness. For internal use, we review catastrophic risks like oversight evasion before extensive rollout.

xAI · Dec 31, 2025 · full quote

Frameworks and decision gates

Another line of support emphasizes formal governance: developers should define risk thresholds, assess models against them, apply mitigations, and review both the assessment and mitigation adequacy before deployment or extensive internal use. In this view, a published framework or safety plan structures internal deployment decisions through documented processes.

Each large frontier developer shall begin to develop a frontier AI framework to govern how the large frontier developer will: [...] Establish thresholds to assess whether a frontier model has capabilities that could pose a catastrophic risk [...] Apply a mitigation to address the…

Melissa Shusterman · Sep 22, 2026 · full quote
A large frontier developer shall write, implement, comply with, and clearly and conspicuously publish on its internet website a frontier AI framework that ... [reviews] assessments and adequacy of mitigations as part of the decision to deploy a frontier model or use it extensivel…

California State Legislature · Sep 29, 2025 · full quote
A large frontier developer shall write, implement, comply with, and clearly and conspicuously publish on a publicly available website of such developer a frontier AI framework that satisfies the following requirements: (1) Applies to each frontier model of such developer. (2) Inc…

Jay Obernolte · Jul 22, 2026 · full quote
This bill requires a large frontier developer to implement and clearly publish on its website a public safety plan that describes in detail how the large frontier developer defines and assesses thresholds used by the developer to determine whether a frontier model has capabilitie…

Jason Zachary · Jan 22, 2026 · full quote
A large frontier developer shall write, implement, comply with, and clearly and conspicuously publish on its internet website a frontier AI framework that applies to the large frontier developer's frontier models and describes in detail how the large frontier developer handles al…

New York Senate Bill S10731 (2026) · Oct 28, 2026 · full quote

Oversight beyond self-assessment

Some proponents argue that internal risk assessment should not remain purely internal: they call for risk reports, third-party review, confidential reporting to authorities, or government access before consequential internal deployment. They present outside visibility as a way to ensure attention to the highest-risk internal uses.

Congress should establish a mandatory requirement to provide government access to, and evaluation of, frontier models before consequential internal deployment, to ensure visibility where the biggest risks are likely to emerge.

Institute for AI Policy and Strategy · Sep 11, 2026 · full quote
Do not deploy a risk-relevant model, internally or externally, until a pre-designated decision-maker has reviewed its results on those evaluations against the published triggers. [...] Before internal deployment of a new most-capable model, synthesize the results of the practices…

Guidelight AI Standards · Sep 9, 2026 · full quote
The developer’s publicly available frontier AI framework must describe how the developer reviews risk assessments in deciding to internally deploy the model; [...] the developer must periodically submit confidential reports to the Department of Commerce containing “a summary of a…

Institute for Progress · Aug 6, 2026 · full quote
We will also regularly assess the potential for catastrophic risk from internal use of Frontier AI models and, as appropriate, provide relevant authorities with a summary of these assessments. Frontier AI that meets the high or critical risk threshold requires additional mitigati…

Meta · Apr 8, 2026 · full quote
Whenever a substantially more capable or riskier model is deployed internally, the developer should create a risk report and argue why the model is safe to deploy.

Oscar Delaney · Apr 27, 2026 · full quote

Middle ground

Continuous reassessment

Some quotes do not reject pre-deployment assessment, but argue it should be only one part of a broader oversight system. They say risks can change during deployment, so reviews may need capability-based or incident-based triggers, continual monitoring, and reassessment after mitigations are implemented.

Risk reports commonly use pre-deployment alignment assessments to measure misalignment risk from an internally deployed AI. However, an AI [...] can develop widespread dangerous motivations during deployment. I think [...] AI companies and evaluators should substantively incorpor…

Alex Mallen · May 15, 2026 · full quote
Conducting thorough risk assessments before developing or deploying new models, complemented with continual monitoring (incorporating, for example, evaluation results, evidence from earlier models, and expert forecasts). [...] For example, at a given risk threshold, information s…

Government of the United Kingdom · 2023 · full quote
Risk management standards emphasise that such decisions should follow a continuous and iterative process of risk evaluation and analysis, including reassessment after mitigations are implemented. [...] Because the most cutting-edge AI systems are often deployed internally first, …

Oxford Martin AI Governance Initiative · Feb 24, 2026 · full quote

In the provided quotes, support for assessing frontier models before high-stakes internal deployment is broad and comes from lawmakers, companies, researchers, and advocacy groups. The main live questions are how detailed the required frameworks should be, whether outside oversight is needed, and how much weight to place on ongoing monitoring in addition to any initial pre-deployment review.

Cast Your Vote:

Results (41 votes):

Total (41 votes)

For 41 (100%) Abstain 0 (0%) Against 0 (0%)

New Top

For (41)

Anna Wang
AI safety researcher at Anthropic; previously at Google DeepMind

I am this person! Add a sourced quote Report comment

votes For and says:

“Before a new model can be deployed internally, you must first test it for a minimum, fixed period. [...] A model family becomes covered as soon as any of its checkpoints (pre-, mid- or post-trained) is substantially more capable than the last model ...
more AI Verified source (Nov 11, 2026)

added 4d ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
New York Senate Bill S10731 (2026)
New York frontier-AI safety bill introduced October 28, 2026; it amends the RAISE Act with safety, oversight, and employee-disclosure provisions.

I am this person! Add a sourced quote Report comment

votes For and says:

A large frontier developer shall write, implement, comply with, and clearly and conspicuously publish on its internet website a frontier AI framework that applies to the large frontier developer's frontier models and describes in detail how the large...
more AI Verified source (Oct 28, 2026)

added 5d ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Reflection AI
AI research company developing open-weight frontier models and publishing an Open Safety Framework.

I am this person! Add a sourced quote Report comment

votes For and says:

Internal use: The same systemic-risk assessment applies to internal use of frontier models, including research, operational systems, and internal products. Internal deployment is assessed against the same capability thresholds and safeguards as pre-r...
more AI Verified source (Oct 8, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Manuel Guzman
Pennsylvania state representative for the 127th District and primary sponsor of the Pennsylvania Advanced Artificial Intelligence Accountability and Innovation Act.

I am this person! Add a sourced quote Report comment

votes For and says:

A large frontier developer shall write, implement, comply with and clearly and conspicuously publish on its publicly accessible Internet website a frontier AI framework that applies to the large frontier developer's frontier models and describes how ...
more AI Verified source (Oct 5, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Amos Toh
Human Rights Watch AI researcher

I am this person! Add a sourced quote Report comment

votes For and says:

The primary goal of such regulation is to ensure that frontier models meet stringent safety standards before they are launched on the public market. But this would not address the conditions that triggered the recent hacks: namely, when developers an...
more AI Verified source (Oct 5, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Melissa Shusterman
Pennsylvania state representative for the 157th District; primary sponsor of Pennsylvania House Bill 2800, the Artificial Intelligence Risk Prevention Act.

I am this person! Add a sourced quote Report comment

votes For and says:

Each large frontier developer shall begin to develop a frontier AI framework to govern how the large frontier developer will: [...] Establish thresholds to assess whether a frontier model has capabilities that could pose a catastrophic risk [...] App...
more AI Verified source (Sep 22, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Miles Kodama
AI policy researcher at AI Futures

I am this person! Add a sourced quote Report comment

votes For and says:

The mainstream take is that an AI lab should assess risk before deploying a new model externally. But I think risk assessment should come way earlier in the model lifecycle. Compare the situation with dangerous bio. We wouldn't find it acceptable for...
more AI Verified source (Sep 14, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Institute for AI Policy and Strategy
Think tank developing policy recommendations for frontier artificial intelligence, safety, and national security.

I am this person! Add a sourced quote Report comment

votes For and says:

Congress should establish a mandatory requirement to provide government access to, and evaluation of, frontier models before consequential internal deployment, to ensure visibility where the biggest risks are likely to emerge.
AI Verified source (Sep 11, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Guidelight AI Standards

I am this person! Add a sourced quote Report comment

votes For and says:

Do not deploy a risk-relevant model, internally or externally, until a pre-designated decision-maker has reviewed its results on those evaluations against the published triggers. [...] Before internal deployment of a new most-capable model, synthesiz...
more AI Verified source (Sep 9, 2026) 1 of 2

added 14d ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Chris Lehane
OpenAI chief global affairs officer

I am this person! Add a sourced quote Report comment

votes For and says:

We have strengthened monitoring, alignment, and security safeguards across the model-development lifecycle, including stronger isolation for frontier research workloads, expanded monitoring of model behavior during tool-enabled training and evaluatio...
more AI Verified source (Sep 9, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Institute for Progress
Nonpartisan think tank focused on innovation policy, economic growth, and technological progress.

I am this person! Add a sourced quote Report comment

votes For and says:

The developer’s publicly available frontier AI framework must describe how the developer reviews risk assessments in deciding to internally deploy the model; [...] the developer must periodically submit confidential reports to the Department of Comme...
more AI Verified source (Aug 6, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
FRONTIER Act (H.R. 9925)
Named U.S. federal legislative proposal introduced in 2026 establishing oversight, evaluation, and reporting requirements for frontier AI.

I am this person! Add a sourced quote Report comment

votes For and says:

A large frontier developer shall write, implement, comply with, and clearly and conspicuously publish ... a frontier AI framework that satisfies the following requirements: [...] Identifying risk thresholds utilized by such developer to assess whethe...
more AI Verified source (Jul 23, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Jay Obernolte
U.S. Representative from California

I am this person! Add a sourced quote Report comment

votes For and says:

A large frontier developer shall write, implement, comply with, and clearly and conspicuously publish on a publicly available website of such developer a frontier AI framework that satisfies the following requirements: (1) Applies to each frontier mo...
more AI Verified source (Jul 22, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Massachusetts Senate Committee on Ways and Means
Massachusetts Senate committee that reviews fiscal legislation and issues recommendations to the Senate.

I am this person! Add a sourced quote Report comment

votes For and says:

A large frontier developer shall write, implement, comply with and clearly and conspicuously publish on its internet website a frontier AI framework that applies to the large frontier developer’s frontier models and describes in detail how the large ...
more AI Verified source (Jul 16, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Illinois General Assembly
State legislature of Illinois, United States.

I am this person! Add a sourced quote Report comment

votes For and says:

reviewing assessments and adequacy of mitigations as part of the decision to deploy a frontier model or use it extensively internally; [...] assessing and managing catastrophic risk resulting from the internal use of its frontier models, including ri...
more AI Verified source (Jul 6, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
OpenAI
AI research organization

I am this person! Add a sourced quote Report comment

votes For and says:

We also applied the method to challenging agentic rollouts, showing that it can extend beyond standard chat to more complex agent settings involving tool use, and can also be used for risk assessment before internal model deployments.
AI Verified source (Jun 16, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Mary Edly-Allen
Illinois State Senator (D-Libertyville); lead sponsor of SB 315, a frontier AI safety and transparency bill requiring independent third-party audits of major AI developers

I am this person! Add a sourced quote Report comment

votes For and says:

A large frontier developer shall write, implement, comply with, and clearly and conspicuously publish on its website a frontier AI framework that applies to the large frontier developer's frontier models and describes how the large frontier developer...
more AI Verified source (May 19, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
METR
Nonprofit AI safety research organization that evaluates frontier AI systems.

I am this person! Add a sourced quote Report comment

votes For and says:

Most importantly, third-party evaluations triggered by public deployments are not designed to cover risks from internal use within the developer itself. [...] We believe that periodic third-party assessment of risks from developers’ internal use of A...
more AI Verified source (May 19, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Alex Mallen
AI safety researcher at Redwood Research.

I am this person! Add a sourced quote Report comment

votes For and says:

Risk reports commonly use pre-deployment alignment assessments to measure misalignment risk from an internally deployed AI. However, an AI [...] can develop widespread dangerous motivations during deployment. I think [...] AI companies and evaluators...
more AI Verified source (May 15, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Brad Carson
Americans for Responsible Innovation president

I am this person! Add a sourced quote Report comment

votes For and says:

ARI recommends targeting developers as a proxy for regulating frontier models. This is preferable to a regime targeting individual models, since today’s frontier systems derive their capabilities from a combination of baseline models, scaffolding, an...
more AI Verified source (May 11, 2026)

added 22d ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Joe O'Brien
Researcher on the Frontier Security team at the Institute for AI Policy and Strategy (IAPS), focused on AI assurance, reliability, crisis preparedness, and developer transparency.

I am this person! Add a sourced quote Report comment

votes For and says:

Models used internally at AI companies have capabilities beyond those of publicly-available models, so it's important that risks from these models are reported externally. [...] We argue that whenever a substantially more capable or riskier model is ...
more AI Verified source (Apr 29, 2026)

added 2d ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
UK AI Security Institute
United Kingdom government institute for evaluating advanced AI systems.

I am this person! Add a sourced quote Report comment

votes For and says:

As part of a larger body of work on understanding loss-of-control risks from frontier AI, we’ve been developing methodology to simulate how models internally deployed within AI companies might behave when performing and assisting with AI safety resea...
more AI Verified source (Apr 27, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Google DeepMind
AI research company.

I am this person! Add a sourced quote Report comment

votes For and says:

A model for which the inherent risk assessment indicates a ML R&D CCL has been reached will be deemed to pose an acceptable level of residual risk for further development or deployment, if: We assess that the deployment mitigations have brought the r...
more AI Verified source (Apr 17, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Meta
Social media and AI company

I am this person! Add a sourced quote Report comment

votes For and says:

We will also regularly assess the potential for catastrophic risk from internal use of Frontier AI models and, as appropriate, provide relevant authorities with a summary of these assessments. Frontier AI that meets the high or critical risk threshol...
more AI Verified source (Apr 8, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Gregory A. Miller
Louisiana state senator for District 19 and sponsor of the 2026 Protecting Louisiana's Infrastructure from Artificial Intelligence Risk Act.

I am this person! Add a sourced quote Report comment

votes For and says:

A large frontier developer shall write, implement, comply with, and clearly and conspicuously publish on its internet website a frontier AI framework that applies to the large frontier developer's frontier models and describes in detail how the large...
more AI Verified source (Mar 31, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Gregory A. Miller
Louisiana state senator and primary sponsor of the 2026 Protecting Louisiana's Infrastructure from Artificial Intelligence Risk Act.

I am this person! Add a sourced quote Report comment

votes For and says:

A large frontier developer shall write, implement, comply with, and clearly and conspicuously publish on its internet website a frontier AI framework that applies to the large frontier developer's frontier models and describes in detail how the large...
more AI Verified source (Mar 31, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Oxford Martin AI Governance Initiative
Oxford Martin research initiative studying governance and risk management for frontier artificial intelligence.

I am this person! Add a sourced quote Report comment

votes For and says:

Risk management standards emphasise that such decisions should follow a continuous and iterative process of risk evaluation and analysis, including reassessment after mitigations are implemented. [...] Because the most cutting-edge AI systems are oft...
more AI Verified source (Feb 24, 2026)

added 2mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Kimberly Du Buclet
Illinois state representative for the 5th District; sponsor of the 2026 AI Safety Measures Act.

I am this person! Add a sourced quote Report comment

votes For and says:

A large frontier developer shall write, implement, comply with, and clearly and conspicuously publish on its website a frontier artificial intelligence framework that applies to the large frontier developer’s frontier models and describes how the lar...
more AI Verified source (Feb 2, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Doug Fiefia
Utah State Representative (Republican); former Google employee; co-chair of a national task force on state AI policy

I am this person! Add a sourced quote Report comment

votes For and says:

A large frontier developer shall write, implement, comply with, and clearly and conspicuously publish on the large frontier developer's internet website a public safety plan that describes in detail how the large frontier developer: [...] (b) defines...
more AI Verified source (Jan 27, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.
Jason Zachary
Tennessee state representative for District 14 and Deputy Speaker of the Tennessee House of Representatives.

I am this person! Add a sourced quote Report comment

votes For and says:

This bill requires a large frontier developer to implement and clearly publish on its website a public safety plan that describes in detail how the large frontier developer defines and assesses thresholds used by the developer to determine whether a ...
more AI Verified source (Jan 22, 2026)

added 1mo ago

Choose people for your Council

Their For/Against majority represents you.

Unless you vote directly.