Comment by Elham Tabassi

Tests are proliferating—benchmarks, red teaming, safety and capability evaluations, audits, post-deployment monitoring—but the field lacks the infrastructure that would let their results become comparable and cumulative evidence. [...] Credible evaluation requires resources that individual evaluators cannot easily maintain and that developers should not control alone: these include held-out or refreshed test materials, secure environments for testing potentially dangerous capabilities, reference protocols that enable comparison over time, and common ways to record results. [...] Some of these capabilities are public goods and will require public, philanthropic, or consortium funding structured so that no single developer can determine whether the infrastructure continues to exist or whether unfavorable findings are reported.