Comment by Jon Wolverton

It feels like all the AI labs are constrained by competition to minimize their work on catastrophic risks, even though most industry leaders have an uncomfortably high probability that things could go terribly wrong. This is a technology that doesn't have an off switch you can just flip, and it could easily do as much damage to its creators as to anyone else. Having a framework to allow labs to slow down or pull the plug in case of emergency will help us all sleep a bit better at night.