What's new in AI governance, safety, jobs and society

Can we do enough to make sure that the American people believe that we’re addressing their concerns appropriately without obviously compromising our ability to win?

That requires independent evaluators to red-team AI models before deployment, not voluntary company disclosures.

As organizations unleash the power of agent autonomy, it raises the pivotal and non-negotiable requirement of enforcing governance. [...] With basic AI systems, risk is much more contained compared to that of an autonomous agent that has access to mu...

Internal use: The same systemic-risk assessment applies to internal use of frontier models, including research, operational systems, and internal products. Internal deployment is assessed against the same capability thresholds and safeguards as pre-r...

AI is expected to automate a large number of jobs. But when large numbers of people lose their means of earning a living, the situation cannot stay unbalanced forever. [...] History has repeatedly shown that societies do not stay in extreme imbalance...

To manage risks from advanced AI systems we need clear safety standards, continuous testing, and reporting of serious failures. [...] Employees and contractors who report safety, security or compliance concerns should be protected from retaliation.

Developers must remain liable under applicable civil and criminal law for foreseeable harms and unlawful conduct arising from their AI systems, including when their design, deployment, modification or failure to implement reasonable safeguards materi...

Allies should establish secure mechanisms to share information on serious AI incidents, emerging catastrophic capabilities, evaluation methods and effective safeguards.

Such a ruling close to Election Day would open a huge opportunity for abuse during a period where harm has outsized impact. Campaigns will use this technology to target voters in deceptive ways.

The first is a federal governance framework targeting frontier AI developers above $500 million in annual revenue. These developers would be required to publish safety frameworks, report critical incidents, and submit to semi-annual third-party audit...

An opt-out system as proposed by AI companies places burdens and costs on rights holders, as it would require ongoing surveillance to see whether copyright material is being used. We cannot scour the internet and ensure we are opting out on all of th...

For a long time many of us thought of RSI as the way AGI turns into superintelligence. [...] I was advocating what I called a semi-hard takeoff: a period where the self-improvement was real but not that fast, followed by a point -- once the AGI fully...

Australia and the US’s Western allies face an incentive and opportunity structure that may promote, and enable, the less instead of the more destructive options. [...] A government that believes access to American frontier models will remain availabl...

We do need to have some safeguards in place to make sure there are no unintended consequences, but, no, I do not think AI is going to imperil human existence.

We need to pause all of the research on this, we need to pause all of the application of AI and just sit down and have a proper think about where this is going, where we want it to go, and how we want it to happen and how we want it to be regulated. ...