Yoshua Bengio

We must be intentional and make collective, democratic choices, rather than letting market forces play out and risking leaving most citizens behind.

To guarantee access to frontier models and mitigate the risks of major power concentrations, middle powers must collaborate to form a broad coalition with shared values and complementary resources.

Besides loss of control, the other catastrophic possibility is humans using AI to construct an eventually worldwide dictatorship. A small group of humans could concentrate all the power that AI will have, especially if we achieve AGI or superintellig...

The simplest form of treaty would be something like this, that the countries agree that if they do develop advanced AI: * That it will be done in a safe way. So maybe using techniques like Scientist AI or whatever else we have strong assurances for. ...

Frontier AI systems could surpass most individuals across most cognitive tasks within just a few years. These advances could unlock solutions to major global challenges, but they also carry significant risks. To safely advance toward superintelligenc...

We must be intentional and make collective, democratic choices, rather than letting market forces play out and risking leaving most citizens behind.

If leading AI companies are indeed approaching the point of recursive self-improvement, a coordinated, verifiable, and universally applied pause is probably the only responsible solution to mitigate several major AI risks; at least until safety guara...

I'm now very confident that it is possible to build AI systems that don't have hidden goals, hidden agendas. [...] A Scientist AI would be trained to give truthful answers based on transparent, probabilistic reasoning.

Advanced AI in the future [must be] a global public good governed safely towards human flourishing for the benefit of all.

We're seeing AIs whose behavior, when they are tested, [...] is different from when they are being used. [This] significantly hampers our ability to correctly estimate risks. [...] The gap between the pace of technological advancement and our ability...

But in the future, who should decide where to draw the line and how to weigh the pros and cons? CEOs of companies or democratically chosen governments? The answer should be obvious if you believe in democracy.

Moreover, frontier AI companies are seeking to develop AI with a specific skill that could very well unlock all others and turbocharge advances: AIs with the ability to advance research in AI. An AI system that would be as capable at AI research as t...

Ideally this would stay in the hands of neutral international organizations (think of a combination of IAEA and CERN for AI) that develop safe and beneficial AI [...] safe superhuman AI

This risk should further motivate us to redesign the global political system in a way that would completely eradicate wars and thus obviate the need for military organizations and military weapons. [...] It goes without saying that lethal autonomous...

I think it's really important, because when we put open source out there for something that could be dangerous, which is a tiny minority of all the code that's open source, essentially we're opening the door to all the bad actors. And as these system...