Joe Rogero

Any training runs above the Monitored Threshold in a signatory’s jurisdiction require a report to the CTB including code, data, and estimated FLOP.

If anyone, anywhere builds a superhuman artificial intelligence using present methods, the most likely outcome is catastrophe.

Like the nuclear nonproliferation agreements before it, the draft Agreement aims to prevent the proliferation of technologies that would be catastrophic for humanity if allowed to proceed unchecked.

Any training runs above the Monitored Threshold in a signatory’s jurisdiction require a report to the CTB including code, data, and estimated FLOP.

International governance thus requires some way to track these high-end chips. [...] Chips can be designed or modified to remotely confirm their location. [...] Regulators can require chip manufacturers to install such mechanisms.

If states are able to pull together and commit to an international agreement, it seems possible to set up a verification regime and avert global catastrophe.