Expert opinions on AI Risk

I think we’ve got the beginnings of a pretty good story, because we can already build machines that can represent environments. [...] If that’s what you mean by consciousness—having beliefs, having desires, being able to report what those beliefs and...

“I would be surprised if current AI models develop consciousness,” he said, “but we can’t entirely rule it out.”

Personally, I do not believe that AI can be conscious, and below I explain why.

Internal use: The same systemic-risk assessment applies to internal use of frontier models, including research, operational systems, and internal products. Internal deployment is assessed against the same capability thresholds and safeguards as pre-r...

Physicists faced a version of this problem in the 1950s. No single lab could afford the machine they needed, so they pooled resources and built one together, with shared data and shared credit. This piece sketches what the same move could look like f...

It is irresponsible for society to allow them to move forward and make these products even more advanced. That’s why I am introducing legislation to immediately pause the development of increasingly powerful AI and ban the creation of systems that hu...

For a long time many of us thought of RSI as the way AGI turns into superintelligence. [...] I was advocating what I called a semi-hard takeoff: a period where the self-improvement was real but not that fast, followed by a point -- once the AGI fully...

I do not think this will happen. I don’t think that automating AI R&D will rapidly produce domain-general superintelligence. I don’t think that a data centre of geniuses, largely separated from the rest of the economy, will figure out how to cure Alz...

The most interesting risk in AI is not the OpenAI and Anthropic models. It's open-source models. They're way more dangerous because they can't be monitored.

Restricting access to a dual-use AI model is precautionary only if it delays harmful actors more than defenders. That condition varies across actors: a state agency or organized criminal group may obtain a substitute through theft, distillation, inte...

If safeguards are properly followed, businesses, including banks, should have enough guarantees to essentially run any model, regardless of where they come from.

I believe it’s an engineering problem ... and we all need to hope that’s an engineering problem. If it’s not an engineering problem, it’s not solvable.

Many AI researchers grant these concerns and recognize that the hard version of the alignment problem is unsolved; however, they generally believe that the better models of the future will help solve it. I fear we may already be near the point where ...

We don't believe the AI industry has solved alignment and monitoring to a sufficient degree to responsibly scale at maximum speed.

The scientific work now is to ensure reasoning of powerful AI models remains observable as they become more capable, or to build the tools to read it where it is not, and to verify that complete AI systems, not just the models inside them, can be rel...

We have a very natural instinct to say: we want as much interpretability as possible. One of the sci-fi worry cases is that agents start speaking in languages to each other that we don't understand. [...] I bet there are ways to define boundaries tha...

Explainable AI (XAI) is often offered as the answer to the black box problem and is broadly defined as “machine learning techniques that make it possible for human users to understand, appropriately trust, and effectively manage AI.” Around the world...

Before, or concurrently with, deploying a new frontier model or a substantially modified version of an existing frontier model, a large frontier developer shall include in the transparency report required by paragraph (a) of this subdivision, summari...

For the most advanced frontier AI models, an independent, federally overseen, industry-backed organization could set safety standards and verify independent, voluntary audits, similar to how other critical sectors are managed.

The term “open-weight AI model” means an AI model for which the model weights are made publicly available without restriction on access. [...] “meaningful uplift” means specific operational assistance that would materially advance an adversary’s CBRN...

They tried to pass laws to stifle [free open-source AI software]. ... After that narrative lost credibility, and our government no longer believes that, thank God, the same people said, “Oh, AI could create bioweapons.” After the RAND and other studi...