Comment by Geoffrey Hinton

Just because you’ve developed a new drug doesn’t mean you can put it on the market. You have to persuade the FDA. That takes about a billion dollars’ worth of work. That is at least the requirement that should be demanded of AI.

The development of AI at present is a big race between companies within the U.S. and between the U.S. and China, and that race is gonna lead to superintelligence quite soon. [...] When AI gets smarter than us, it won’t be us that’s making AI smarter;...

Frontier AI companies should rely on evaluators that are meaningfully independent, that maintain full editorial control, and that disclose and mitigate potential conflicts of interest. [...] Frontier AI companies should grant embedded evaluators acce...