Expert opinions on Existential Risk

I cannot exclude the possibility that future machines might regard themselves as autonomous individuals with personal preferences and aversions.

In 2005, I would have answered ‘no’ to the question of whether you could have a mind that was not biological—that existed in the substrate of silicon. Now I just don’t know.

Being open to the possibility that LLMs are conscious is the same as being open to the possibility that Microsoft Word is conscious.

Building on this perspective, the paper examines how dominant approaches to artificial intelligence governance, particularly those centered on labor displacement and income support, leave unaddressed the problem of declining human adaptability in hig...

Much has been said about whether AI poses an ultimate existential threat to humanity. The more immediate existential challenge may be whether technologies that simulate relationships weaken our capacity for the relationships that foster our own human...

By framing AI as a mysterious entity, an existential threat, a utopian savior, or a moral scapegoat, these narratives obscure the reality of AI as a statistical tool.

However, we recommend against publicly releasing frontier model weights.

A safety regime that restricts legitimate defenders, while capable models remain available for attackers, creates an asymmetric disadvantage.

MAP-AI, a new control-plane system architecture for aligned decision-making under uncertainty, enforces alignment through Monte Carlo estimation of outcome distributions and admissibility-controlled policy selection rather than static model-level con...

If it takes over that's what will happen. [...] We don't know how to do that. We don't even know if it's possible.

No amount of computational power or rationality can avoid intrinsic alignment overheads.

Achieving [human-level AGI] would have profound and far-reaching impacts on human society. ... AI progress might continue to accelerate over the next years. This could imply that the image of a single transformative step change, caused by the introdu...

Throwing more words and GPUs into the word-guessing program won't make it sentient. [...] one of our mares gives birth to a locomotive.

The UK must lead an international agreement to prohibit the development of superintelligence until it can be proven safe. If we fail, every other ambition for our country risks being swept aside. The clock is ticking.

The question that the noble Lord posed was: do we therefore go for a moratorium? That would be highly desirable, but I do not think that it will be possible in the short term.

What is needed is not to slow innovation but to harness it — to channel AI’s momentum toward outcomes that reinforce trust, safety and societal well-being.

I would like to see a CERN for AI [...] where all the top scientists come together and see whether they can make a super intelligence. And, if they can, they contain it into a system where it can't just go out and persuade people to let it run the wo...

I call on the governments of the world to take immediate action to end this danger by permanently banning the development of artificial general intelligence and machine superintelligence.