Comment by Marius Hobbhahn

The current regime is definitely not optimal. While third-party evaluators try hard to be unbiased, a lab can decide to stop working with them any day for any reason whatsoever. We really need more stringent regulations to improve the incentives for ...

I think it’s a good plan and I hope we see much more work on this, especially from the people who are deadset on building AGI.

When I read it for the first time my intuitive reaction was like “too many low probability things have to go right for this to work out” Which my brain somehow mapped to “therefore unrealistic” instead of the obvious “it’s a really hard problem and t...