Comment by Theo Bearman

Embedded evaluators are independent external experts placed within frontier AI companies to provide ongoing assessments and validation of a company’s safety, security, and operational systems, practices, and claims. [...] As frontier AI companies begin to operationalize embedded evaluators voluntarily, they have a responsibility to ensure these arrangements help meaningfully buy down risk. [...] Contracts should [...] let embedded evaluators choose the objects of their assessments [...] [and] on a foundation of employee-like access—the embedded evaluator should have the flexibility to select which objects of assessment it will scrutinize.