Expert opinions on AI Ethics

Future risk reports, system cards and external evaluations should be assessed for reproducible methods, clear separation between simulated and real actions, disclosure of missed detections, and evidence that safety interventions do not simply make pr...

For the most advanced frontier AI models, an independent, federally overseen, industry-backed organization could set safety standards and verify independent, voluntary audits, similar to how other critical sectors are managed.

What humanity needs is an international AI nonproliferation treaty.

The U.S. and China won’t move in lockstep on AI safety, and forging mutually binding agreements with real teeth is probably not possible right now.

Such technological advancement will provide society with invaluable tools to address critical global challenges, including drug discovery, economic growth and climate change.

This is going to be the most productive decade in the history of our species. But in order to truly reap the benefits of AI, we need to learn how to contain it. Paradoxically, part of that will mean collectively saying no to certain forms of progress...

Many leading companies are engaged in a single-minded pursuit of artificial general intelligence (AGI). [...] Rather than racing to replace people, we should build AI tools that amplify human expertise and expand opportunity.

We argue that general intelligence may be the only biological strategy that generates existential threats to the species possessing it, an existential risk paradox with no parallel among non-intelligent survival strategies. Unlike prevailing accounts...

Much has been said about whether AI poses an ultimate existential threat to humanity. The more immediate existential challenge may be whether technologies that simulate relationships weaken our capacity for the relationships that foster our own human...

They lack the intrinsic motivation for self-preservation, dominance, or resource competition that underlies existential-risk scenarios, and the embodied vulnerability required for feeling or suffering.

Pause AI development. It is not too late to avoid disaster. Stop building machines that humans cannot control. Let me be very clear: If you do not take appropriate action now, my colleagues and I in the U.S. Senate will.

I believe that attempting to deliberately pace AI development will be extremely difficult, and could do more harm than good if done without proper care. However, I am signing this statement because, if an attempt at pacing does occur, it would be bet...

One rather draconian solution to all these problems, proposed earlier this week by Andrea Miotti, would be to create an “International Treaty to Ban Superintelligence.” Why worry about what to do with the latest and greatest models if you can make th...

Every action and every outcome needs to be clarified and justified to a board, an auditor, or a customer.

We have a very natural instinct to say: we want as much interpretability as possible. One of the sci-fi worry cases is that agents start speaking in languages to each other that we don't understand. [...] I bet there are ways to define boundaries tha...

Explainable AI (XAI) is often offered as the answer to the black box problem and is broadly defined as “machine learning techniques that make it possible for human users to understand, appropriately trust, and effectively manage AI.” Around the world...

The way to get there is a shared machine-readable format. I call it a Safety Framework Card.

So I don't see any risk associated with open sourcing models. I only see benefits.

There is a significant chance of conscious LLMs within a decade.

We will not just one day have an easy answer where everybody will agree.

A conscious being isn’t a word-guessing app that knows more words and has more computing power to guess with.

We think it’s still good to recommend what would actually be good, even if you think that your audience is probably not going to listen.

A doctrine whose trigger mechanism can be this thoroughly disputed cannot function as a deterrent. Deterrence requires certainty. MAD worked because both sides knew, with something close to certainty, what a launch would produce. MACD, as currently s...

AI should become a bridge for cooperation, not a tool for division. WAICO will also help ensure AI is managed in a safe, trustworthy, and ethical manner.

The answer isn't convergence for its own sake. We can push too hard on one thing. But if you have one standard, you could risk a lowest common denominator outcome that can cost us the innovation system as well and might have a risk on the national in...