Comment by Apollo Research

Apply access parity between internal and external evaluators. Where a frontier AI company’s internal evaluations relied on particular access modalities, then their external evaluators should receive functionally equivalent access unless the AI compan...

To address this emerging challenge and guarantee state-of-the-art AI assurance, external evaluators need deeper access, including white-box access, to counter evaluation awareness.

Black-box evaluations have historically proven valuable to provide a precursory assessment of the safety and security of frontier AI models ahead of model deployment.