Comment by Transluce

Labs’ willingness to more directly embed independent evaluators opens significant opportunities for improving oversight at a critical time. [...] Embedded evaluators design and deploy effective monitors across all of the lab’s meaningful agent swarms and regularly audit labs’ own monitoring practices and coverage. [...] Embedded evaluators use access to unreleased model versions (e.g., experimental models, helpful only models) and model internals (e.g., activations, knowledge of architecture specifics) to study emerging trends in misalignment.