Yoshua Bengio

This suggests pacing the advances: not training or deploying AIs without a strong safety case that convinces independent experts.

This suggests pacing the advances: not training or deploying AIs without a strong safety case that convinces independent experts.

Besides loss of control, the other catastrophic possibility is humans using AI to construct an eventually worldwide dictatorship. A small group of humans could concentrate all the power that AI will have, especially if we achieve AGI or superintellig...

The simplest form of treaty would be something like this, that the countries agree that if they do develop advanced AI: * That it will be done in a safe way. So maybe using techniques like Scientist AI or whatever else we have strong assurances for. ...

Frontier AI systems could surpass most individuals across most cognitive tasks within just a few years. These advances could unlock solutions to major global challenges, but they also carry significant risks. To safely advance toward superintelligenc...

The right way to do this is if a model, before it is released in open weights or in other ways, a model should be tested. Can it be used by people? Are we sure we’re not going to lose control of it? Does it have the capabilities or intentions that co...

I'm now very confident that it is possible to build AI systems that don't have hidden goals, hidden agendas. [...] A Scientist AI would be trained to give truthful answers based on transparent, probabilistic reasoning.

But in the future, who should decide where to draw the line and how to weigh the pros and cons? CEOs of companies or democratically chosen governments? The answer should be obvious if you believe in democracy.

Moreover, frontier AI companies are seeking to develop AI with a specific skill that could very well unlock all others and turbocharge advances: AIs with the ability to advance research in AI. An AI system that would be as capable at AI research as t...

I think it's really important, because when we put open source out there for something that could be dangerous, which is a tiny minority of all the code that's open source, essentially we're opening the door to all the bad actors. And as these system...