Expert opinions on Ethics

Cybersecurity and defense procurement should require rigorous legal and technical review throughout the development, lifecycle, and acquisition of agentic systems, alongside independent evaluations, incident reporting, and meaningful mechanisms for h...

Existing responsible AI governance frameworks mandate human oversight. Yet they share a critical assumption: that competent human overseers remain present and capable of exercising meaningful oversight and control over AI decisions. Accountability mu...

A lot of tools can tell you an AI agent is behaving strangely. Very few can act on that at the network layer, without waiting on a human to approve a ticket. That’s the piece we’re closing.

Yea this is the most important result of the year, at the level of significance of “Attention Is All You Need”. It brings us from “is alignment even solvable” to “we may solve alignment in the next year.”

I used to always think that, you know, alignment will just fall out. I no longer believe that. So I think this alignment thing may be a harder, different problem.

As I see it, solving alignment for LLMs isn’t just impossible, it’s incoherent: we can’t even articulate what it would look like to succeed.

If Anthropic was just one voice among many, this would not matter. But given its market-leading position and the risk that the industry develops as an oligopoly, society as a whole may wish to have some say over what is good for it. There are ways to...

We can put these companies on notice that they’re going to be evaluated by folks that understand the process, that understand the technology, and will be transparent and hold them accountable so that they create safe products, and they don’t send out...

It’s a very thorny area. It’s uncharted territory. There’s a good argument to be made on either side.

I just don’t think the developer is in a position to know exactly how their product is being used.

Some people worry that giving AIs separate legal personhood would let AI companies, or bad actors using AIs, shield themselves from responsibility. But it doesn’t have to work that way… when a Walmart delivery driver runs over a pedestrian, we want t...

There is a reasonable chance, however, that if the vision for AI agents comes to pass, then for our markets and legal accountability regimes to function effectively, agents will have to have the capacity to sue and be sued directly. This is the defin...

Machines are tools, not persons. Today, some propose granting these systems rights, or even legal personhood. Such an approach risks obscuring human responsibility and leaving those who suffer harm to confront a faceless entity.

“Reviewing assessments and adequacy of mitigations as part of the decision to deploy a frontier model or use it internally. Before, or concurrently with, deploying a new frontier model or a substantially modified version of an existing frontier model...

Open models have a tendency to be less safe a lot of the time than closed ones. Maybe it could be misused by someone who downloads it and modifies it to remove safeguards or to sharpen its harmful capabilities. This type of fine-tuning could cost hun...

Restricting access to a dual-use AI model is precautionary only if it delays harmful actors more than defenders. That condition varies across actors: a state agency or organized criminal group may obtain a substitute through theft, distillation, inte...

Open-weight models have been a boon for defenders. When Hugging Face investigated how OpenAI-powered agents penetrated its systems, proprietary models refused some of the forensic work, but the Chinese open-weight model GLM-5.2 helped reconstruct the...

External evaluators should be embedded at AI companies, but they should not be restricted to AI safety researchers, and they should not be selected by the company being evaluated. Rather, they should represent communities across society, address a mu...

the bad news: Dario estimates that in 6 months AI will have the ability to take over the internet the worse news: Anthropic's current commitment to stopping this is... putting independent evaluators in desks in their office have a great day

They really become part of the company, which makes it difficult to criticize it because the staffers become almost your friends.

make provision about a requirement for consent to generate a likeness of a person using, or with the assistance of, artificial intelligence; to make further provision relating to that requirement; to make provision about civil action in circumstances...

A handful of bills introduced this year seek to categorically ban “deepfakes.” In other words, these bills would make it unlawful to create or share AI-generated content depicting someone saying or doing something that the person did not in reality s...

Dialog Lab does not generate, recommend, or support decisions involving any of the following: [...] Hiring decisions. Requests of this kind are declined, and users are redirected to the appropriate human review pathway.

As with any technology, the need for regulation depends on how it is deployed, the nature of harm that may be caused, and whether existing measures are effective in addressing those harms. Where existing measures are assessed to be inadequate and a s...

The extensive disclosure, auditing, and human-review mandates could slow hiring processes, increase administrative costs, and discourage employers—especially smaller ones—from using tools that streamline workforce management.

Decisions involving the use of lethal force, the deprivation of human life, and the escalation of conflict must never be abdicated to autonomous algorithms. Meaningful human control and accountability remain the non-negotiable bedrock of internationa...

A broad consensus has emerged that, regardless of the system, humans must retain responsibility for decisions to use force.

The ICRC has called for legally binding rules that would: Prohibit those autonomous weapons that pose the greatest threat, namely: “Unpredictable” autonomous weapons, whose effects cannot be sufficiently understood, predicted and explained; and auton...

Senator Ricketts has championed legislation to strengthen AI innovation and development, protect America’s competitiveness against Communist China, and prioritize Americans’ safety and security. [...] Guidelines for User Age-verification and Responsi...

Sweeping bans of anything are hard to enact and enforce, but the risks of generative AI are too great to dismiss bold measures as unfeasible. [...] In the absence of a wholesale ban on all interactions between juveniles and relational AI, a default s...

We all just want peace of mind that our kids will be okay growing up in this era of algorithms and AI. That’s why we need guardrails in place to keep up with ever-evolving technology like chatbots and make sure our kids’ safety, mental health, and we...

Claude cannot be used to decide or recommend who to investigate, arrest, or charge in a law enforcement or criminal justice process.

Artificial intelligence, digital forensics, and geospatial intelligence are transforming how we anticipate threats and conduct investigations.

Physicists faced a version of this problem in the 1950s. No single lab could afford the machine they needed, so they pooled resources and built one together, with shared data and shared credit. This piece sketches what the same move could look like f...

It is irresponsible for society to allow them to move forward and make these products even more advanced. That’s why I am introducing legislation to immediately pause the development of increasingly powerful AI and ban the creation of systems that hu...

We should take decisive action now so that we can slow down, as the CEOs have recently acknowledged, slow down the pace of development in order to protect the American people and ensure that AI is proceeding safely.

I’m confident that a cooperative international approach (Plan A) is better than the alternatives because the alternatives involve being in a race during the intelligence explosion, which incurs huge risks. I’m not confident about the exact variant of...

We can put guardrails, we can do this and that, but I think you have a lot of negative forces that are bringing it up that ... shouldn’t be bringing it up, and they’re bringing up things that won’t happen. But whoever wins with AI wins.