Expert opinions on Research Policy

There's much more to do, including giving CAISI the authority to create the standards we need to know whether a frontier model is safe before it ships, not after something goes wrong.

However, it is important to differentiate regulating applications (which we need) vs. regulating the technology (which is ill-advised).

to actually take my voice and use it to train something without my permission, I think that should be illegal.

If we create a new right to control training, that will not give creative workers control over AI training... It will give our bosses control over AI training, because they will amend our standard contracts to demand that we sign away our training ri...

We need an international forum for discussion that establishes globally accepted standards for testing, provides expert and impartial analysis of capabilities and risks, and serves as a venue for cooperation among nations.

But the main regret I have with this talk is that I wish I had prepared a more for the section on a “CERN for AI.” The idea behind such a project is to pool many countries’ and companies’ resources into a single (possibly physically decentralized) ci...

Currently, so many needs for innovation are put under the label of AI that there will be no way to address them with a single organisation.

Our main focus is to build truly recursive, self-improving superintelligence at scale, which means that the entire process of ideation, implementation, and validation of research ideas would be automatic.

This is going to be the most productive decade in the history of our species. But in order to truly reap the benefits of AI, we need to learn how to contain it. Paradoxically, part of that will mean collectively saying no to certain forms of progress...

A better tech future moves from artificial general intelligence to augmented collective intelligence, where AI amplifies rather than replaces human agency.

The simplest form of treaty would be something like this, that the countries agree that if they do develop advanced AI: * That it will be done in a safe way. So maybe using techniques like Scientist AI or whatever else we have strong assurances for. ...

If somebody says, 'This technology is so powerful that we need a global treaty to slow it down,' then I would say: Then take your foot off the accelerator yourself if you think it's moving too fast.

SB 315 takes the safety practices leading labs already follow voluntarily—publishing a safety framework, transparent reporting, protecting whistleblowers—and helps establish a baseline that every leading AI developer is expected to meet. [...] Illino...

Connecticut already has strong whistleblower laws that protect employees from retaliation. [...] creating a separate, AI-specific whistleblower regime could lead to confusion, duplication, and unintended consequences for employers operating in highly...

I would like to see a CERN for AI [...] where all the top scientists come together and see whether they can make a super intelligence. And, if they can, they contain it into a system where it can't just go out and persuade people to let it run the wo...

Well, there are positive signs, for instance, like Henry Kissinger was recently suggested in foreign affairs that the US cooperate with China on this issue now, but before it's too late. So I think some people are recognizing the the importance of tr...

I call on the governments of the world to take immediate action to end this danger by permanently banning the development of artificial general intelligence and machine superintelligence.

platforms that host libraries of open-source AI models to ensure that models are uploaded with appropriate system and safety information

I do not believe this is the best approach to protecting the public from real threats posed by the technology.

However, it is important to differentiate regulating applications (which we need) vs. regulating the technology (which is ill-advised).

Create a single, dedicated talent hub, accompanied by 1-5 separate compute hubs;

Unlike CERN, which focuses on fundamental research, the EU’s new AI centre will also concentrate on innovation and technology production, areas which Europe – including Switzerland – has yet to strengthen. This is why the project envisages a network ...