We can't find the internet
Attempting to reconnect
Something went wrong!
Hang in there while we get back on track
Comment by Dawn Song
Co-author; AI researcher
Frontier AI capabilities are advancing rapidly, and the pace of progress is itself accelerating. We see this directly in our evaluation work. CyberGym and ExploitGym show that frontier AI agents are now capable of discovering and exploiting real-world software vulnerabilities, which without appropriate safeguards, could enable cyberattacks at scale. Many researchers also consider recursive self-improvement (RSI) plausible within the next few years, accelerating progress in a way that could outpace our ability to understand and govern these systems. Deliberate pacing is a heavy-handed and potentially extreme measure, and we may never need it. But if we do, it cannot be safely invented in the middle of a crisis. It is very difficult to design well, and if done poorly could do more harm than good. Any successful coordination framework must be evidence-based, avoiding arbitrary thresholds that fail to capture true risk while stifling innovation, and instead be grounded in rigorous, measurable assessments of risk. Like any critical infrastructure, it must be researched, tested, and built before it is needed. This is why we must carefully design it now, rather than waiting. Such a capability must be international and measurable: international because no single lab or country can pace a frontier everyone else is racing toward; measurable because effective governance requires rigorous, transparent, and verifiable evaluations of frontier AI systems. We do not know if, or when, deliberate pacing will become necessary. But building the capacity now, including technical and governance tools and an international cooperation framework, gives society valuable optionality. To be effective, this needs to exist before the decisive moment arrives. At the speed the frontier is moving, that moment may arrive sooner than we expect. Building the capacity is not the same as deciding when, or whether, to use it. The latter remains a matter for public deliberation and democratic governance.AI Verified (Jul 2026)
Policy proposals and claims
votes For
Statement relation comments
AI Verified
The comment urges prebuilt international, measurable tools to deliberately pace frontier AI for safety; this strongly supports a safety-gated halt/pacing approach.
·
Hector Perez Arenas
gpt-5.6
· 1h ago
Vote answer comments
AI Verified
Recorded answer for. Dawn Song supports building capacity to deliberately pace frontier AI when risk requires it; this favors the safety-gated restriction.
·
Hector Perez Arenas
gpt-5.6
· 1h ago
Quote authenticity verification history
Report thisQuote authenticity comments
AI Verified
Pacing the Frontier (July 2026) publishes this exact Dawn Song comment and attributes it to her.
·
Hector Perez Arenas
gpt-5.6
· 1h ago
replying to Dawn Song