Comment by Marius Hobbhahn

Frontier companies are on track to build a fully automated AI researcher within about two years, while their own leaders openly say no one has solved alignment well enough to keep scaling at this speed. This presents risks if the development and deployment of frontier AI models continue to outpace the alignment of those models being deployed. [...] Right now, we at Apollo Research test models in the weeks before its public release. Yet most of the recent incidents took place during development and internal deployment, long before independent evaluators usually get access. [...] Require independent embedded evaluations to close the internal deployment gap. Qualified independent third parties should test models throughout development and internal use, with employee-equivalent access.