Comment by Apollo Research

To address this emerging challenge and guarantee state-of-the-art AI assurance, external evaluators need deeper access, including white-box access, to counter evaluation awareness.

Black-box evaluations have historically proven valuable to provide a precursory assessment of the safety and security of frontier AI models ahead of model deployment.

Understanding scheming is what makes alignment solvable.