Expert opinions on AI Risk

Before, or concurrently with, deploying a new frontier model or a substantially modified version of an existing frontier model, a large frontier developer shall include in the transparency report required by paragraph (a) of this subdivision, summari...

For the most advanced frontier AI models, an independent, federally overseen, industry-backed organization could set safety standards and verify independent, voluntary audits, similar to how other critical sectors are managed.

I believe we're there now, and I believe the current models will take us there. The future is just so amazing that we are lucky enough to be born at this moment of time, right when everything is like bursting into a big bang of consciousness.

We will not just one day have an easy answer where everybody will agree.

AI cannot become conscious, nor can any machine aspect of technology or humanity.

The mainstream take is that an AI lab should assess risk before deploying a new model externally. But I think risk assessment should come way earlier in the model lifecycle. Compare the situation with dangerous bio. We wouldn't find it acceptable for...

Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives.

I do not think this will happen. I don’t think that automating AI R&D will rapidly produce domain-general superintelligence. I don’t think that a data centre of geniuses, largely separated from the rest of the economy, will figure out how to cure Alz...

Alignment cannot depend on one AI becoming perfectly trustworthy.

Jacob is correct here—we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and ar...

But alignment is no solution: it is an unsolved scientific and technical problem whose solutions—to the extent that we have them—cannot simply be imposed on every AI company operating on Earth.

When the safety guardrails are stripped out of a capable model, it can be used at scale for harm in ways a single person could never manage manually. [...] The leading open-weight models are often not too far behind the best closed models. As they gr...

Restricting access to a dual-use AI model is precautionary only if it delays harmful actors more than defenders. That condition varies across actors: a state agency or organized criminal group may obtain a substitute through theft, distillation, inte...

If safeguards are properly followed, businesses, including banks, should have enough guarantees to essentially run any model, regardless of where they come from.

A model that explains itself less isn't more aligned, it's just harder to catch when it goes wrong.

We have a very natural instinct to say: we want as much interpretability as possible. One of the sci-fi worry cases is that agents start speaking in languages to each other that we don't understand. [...] I bet there are ways to define boundaries tha...

Explainable AI (XAI) is often offered as the answer to the black box problem and is broadly defined as “machine learning techniques that make it possible for human users to understand, appropriately trust, and effectively manage AI.” Around the world...

I would like to see a CERN for AI [...] where all the top scientists come together and see whether they can make a super intelligence. And, if they can, they contain it into a system where it can't just go out and persuade people to let it run the wo...

It is irresponsible for society to allow them to move forward and make these products even more advanced. That’s why I am introducing legislation to immediately pause the development of increasingly powerful AI and ban the creation of systems that hu...

If mandated AI safety reviews are to have any teeth, they must be accompanied by a ban on dangerous AI models that have failed their assessments. This means that some method must be found to restrict access to dangerous open weight AI models. [...] C...

They tried to pass laws to stifle [free open-source AI software]. ... After that narrative lost credibility, and our government no longer believes that, thank God, the same people said, “Oh, AI could create bioweapons.” After the RAND and other studi...