Expert opinions on AI Regulation

Every AI agent should have a clear identity, role, and level of authority, along with oversight and recourse mechanisms. It’s imperative that every AI agent has a named human responsible for its actions. For enterprises to confidently trust AI agents...

Existing responsible AI governance frameworks mandate human oversight. Yet they share a critical assumption: that competent human overseers remain present and capable of exercising meaningful oversight and control over AI decisions. Accountability mu...

A lot of tools can tell you an AI agent is behaving strangely. Very few can act on that at the network layer, without waiting on a human to approve a ticket. That’s the piece we’re closing.

IMDA and CSA are therefore studying how to strengthen the reporting of serious AI-related incidents, including whether additional reporting or information-sharing arrangements are needed. We will draw on international approaches and build on existing...

Rather than creating entirely new channels, policymakers should focus on ensuring that existing channels can effectively incorporate information related to frontier models and agents. Building on trusted relationships will be faster and more effectiv...

Transparency labels should be legally required for synthetic (AI) content in electoral communications such as ads.

You can say dishonest things whether they're AI or not.

Yea this is the most important result of the year, at the level of significance of “Attention Is All You Need”. It brings us from “is alignment even solvable” to “we may solve alignment in the next year.”

I used to always think that, you know, alignment will just fall out. I no longer believe that. So I think this alignment thing may be a harder, different problem.

As I see it, solving alignment for LLMs isn’t just impossible, it’s incoherent: we can’t even articulate what it would look like to succeed.

If Anthropic was just one voice among many, this would not matter. But given its market-leading position and the risk that the industry develops as an oligopoly, society as a whole may wish to have some say over what is good for it. There are ways to...

If consciousness started to emerge in training, I would call for everyone to stop AI development until we could design out those properties.

Governments must assume their responsibilities. It is the first responsibility of any government to protect its citizens – including from the threats of artificial intelligence. National action is essential. But global coordination is also indispensa...

It's actually impossible to control it unless we think the entire world is going to sing kumbaya and say let's slow down, which as you said is unlikely. So if that's the case, fine. You put slowdown here maybe. Well, okay. Does it mean Japan slows do...

Turns out, we were being unnecessarily pessimistic. Even though the planet is on fire, extreme temperatures will not be the ones to knock us out of the evolutionary game. (So much for our soggy paper straws.) Instead, we’ve decided to build something...

To get from today’s AI to human extinction requires a long chain of assumptions. [...] Luckily, none of the steps on this list have come to pass yet. [...] However, something being difficult to disprove does not make it likely. [...] Possibility is b...

We do need to have some safeguards in place to make sure there are no unintended consequences, but, no, I do not think AI is going to imperil human existence.

We can put these companies on notice that they’re going to be evaluated by folks that understand the process, that understand the technology, and will be transparent and hold them accountable so that they create safe products, and they don’t send out...

It’s a very thorny area. It’s uncharted territory. There’s a good argument to be made on either side.

I just don’t think the developer is in a position to know exactly how their product is being used.

Some people worry that giving AIs separate legal personhood would let AI companies, or bad actors using AIs, shield themselves from responsibility. But it doesn’t have to work that way… when a Walmart delivery driver runs over a pedestrian, we want t...

There is a reasonable chance, however, that if the vision for AI agents comes to pass, then for our markets and legal accountability regimes to function effectively, agents will have to have the capacity to sue and be sued directly. This is the defin...

Machines are tools, not persons. Today, some propose granting these systems rights, or even legal personhood. Such an approach risks obscuring human responsibility and leaving those who suffer harm to confront a faceless entity.

Alternatively, a second idea suggested by Greg Ip of the Wall Street Journal, Nobel Prize winners Paul Krugman and Daron Acemoglu (with co-authors Andrea Manera and Pascual Restrepo) is to rectify the current imbalance of taxation on labor and capita...

To date, BPC has not taken a position on whether AI should be taxed and does not endorse any particular option in this issue brief. [...] The code treats labor and capital differently: Employers owe payroll taxes on wages, while investments in equipm...

AI will most certainly change the labor market. But it has not yet changed the complementary relationship between workers and the tools that make them more productive. Taxing the machines is simply a softer version of the Luddite English textile work...

When an OpenAI engineer sounded the alarm on the rapid pace of AI development, warning that this technology has the potential to have cataclysmic consequences, it wasn’t just deeply alarming—but a call to action. Critically, the 2026 International AI...

The FRONTIER Act is a targeted bill with clear, uniform transparency, and safety standards, instead of a fifty-state patchwork. I'm glad to support this bipartisan effort so that Congress acts before this technology outruns us.

Independent third-party AI auditors will act like financial accounting firms: investigating and verifying safety protocols and legal compliance. They’re a critical part of the safeguards needed around powerful frontier AI models.

You’ll see industry oppose outside auditors and the main reason is they would mandate something that can’t be done [today] in a robust and uniform manner.

Open models have a tendency to be less safe a lot of the time than closed ones. Maybe it could be misused by someone who downloads it and modifies it to remove safeguards or to sharpen its harmful capabilities. This type of fine-tuning could cost hun...

Restricting access to a dual-use AI model is precautionary only if it delays harmful actors more than defenders. That condition varies across actors: a state agency or organized criminal group may obtain a substitute through theft, distillation, inte...

Open-weight models have been a boon for defenders. When Hugging Face investigated how OpenAI-powered agents penetrated its systems, proprietary models refused some of the forensic work, but the Chinese open-weight model GLM-5.2 helped reconstruct the...

The AI Biosecurity Lab will be a major new global institution bringing together world-leading scientific expertise to keep the country safe.

But the main regret I have with this talk is that I wish I had prepared a more for the section on a “CERN for AI.” The idea behind such a project is to pool many countries’ and companies’ resources into a single (possibly physically decentralized) ci...

There are many conceivable versions of a “CERN for AI.” But the version that seems politically realistic (a new catch-up lab) probably would not do much for safety, while the versions that would materially improve safety (e.g., pause + merge of all c...

External evaluators should be embedded at AI companies, but they should not be restricted to AI safety researchers, and they should not be selected by the company being evaluated. Rather, they should represent communities across society, address a mu...

the bad news: Dario estimates that in 6 months AI will have the ability to take over the internet the worse news: Anthropic's current commitment to stopping this is... putting independent evaluators in desks in their office have a great day

They really become part of the company, which makes it difficult to criticize it because the staffers become almost your friends.