Joe Rogero

If anyone, anywhere builds a superhuman artificial intelligence using present methods, the most likely outcome is catastrophe.

Like the nuclear nonproliferation agreements before it, the draft Agreement aims to prevent the proliferation of technologies that would be catastrophic for humanity if allowed to proceed unchecked.

Any training runs above the Monitored Threshold in a signatory’s jurisdiction require a report to the CTB including code, data, and estimated FLOP.

International governance thus requires some way to track these high-end chips.