Anthony Aguirre

If humans want to stay in charge of their own civilization, it will take more than a unilateral temporary pause.

We are approaching a runaway to superintelligence that could threaten our shared human future. Both publicly and privately, AI companies are recognizing that a pause or slowdown in certain developmental pathways is crucial to protect lives and liveli...

President Trump is exactly right: advanced AI systems need a robust off-switch to ensure humans never lose control over them.

This is not labour displacement like previous technologies, but a wholesale drop-in replacement of tens of per cent of the labour force.

The crucial thing is that there is an external evaluation system that can test, by an independent agency or authority, that an AI system is safe and reliable before it goes to market, just as Max was discussing.

We are approaching a runaway to superintelligence that could threaten our shared human future. Both publicly and privately, AI companies are recognizing that a pause or slowdown in certain developmental pathways is crucial to protect lives and liveli...

The assurance dilemma has a solution in the form of assurance mechanisms: processes that allow parties to verify compliance with agreements. [...] Nuclear non-proliferation treaties, for example, rely on monitoring uranium supplies and enrichment fac...

Whether it's soon or it takes a while, after we develop superintelligence, the machines are going to be in charge — and that is not an experiment that we want to just run toward. [...] Many people want powerful AI tools for science, medicine, product...

Time is running out. [...] The only thing likely to stop AI companies barreling toward superintelligence is for there to be widespread realization among society at all its levels that this is not actually what we want.

The development of full artificial general intelligence – what we will call here AI that is "outside the Gates" – would be a fundamental shift in the nature of the world: by its very nature it means adding a new species of intelligence to Earth with ...

The development of full artificial general intelligence – what we will call here AI that is "outside the Gates" – would be a fundamental shift in the nature of the world: by its very nature it means adding a new species of intelligence to Earth with ...

Time is running out. [...] The only thing likely to stop AI companies barreling toward superintelligence is for there to be widespread realization among society at all its levels that this is not actually what we want.

We don't have to do this. We have human-competitive AI, and there's no need to build AI with which we can't compete. We can build amazing AI tools without building a successor species. The notion that AGI and superintelligence are inevitable is a cho...