What's new in AI governance, safety, jobs and society

AI needs regulating because its harms are severe, hard to undo, borne by people who never chose them and sometimes invisible until they arrive. [...] The market will not fix this alone, because the incentives reward speed and capability, and even the...

AI is expected to automate a large number of jobs. But when large numbers of people lose their means of earning a living, the situation cannot stay unbalanced forever. [...] History has repeatedly shown that societies do not stay in extreme imbalance...

An agent is a set of actions: read a ticket, look up a customer, draft a reply, update a field, send an email, issue a refund. Each action carries different risk. The right question is: What action needs what kind of human approval? [...] Low reversi...

To manage risks from advanced AI systems we need clear safety standards, continuous testing, and reporting of serious failures. [...] Employees and contractors who report safety, security or compliance concerns should be protected from retaliation.

Developers must remain liable under applicable civil and criminal law for foreseeable harms and unlawful conduct arising from their AI systems, including when their design, deployment, modification or failure to implement reasonable safeguards materi...

Allies should establish secure mechanisms to share information on serious AI incidents, emerging catastrophic capabilities, evaluation methods and effective safeguards.

Such a ruling close to Election Day would open a huge opportunity for abuse during a period where harm has outsized impact. Campaigns will use this technology to target voters in deceptive ways.

The first is a federal governance framework targeting frontier AI developers above $500 million in annual revenue. These developers would be required to publish safety frameworks, report critical incidents, and submit to semi-annual third-party audit...

An opt-out system as proposed by AI companies places burdens and costs on rights holders, as it would require ongoing surveillance to see whether copyright material is being used. We cannot scour the internet and ensure we are opting out on all of th...

The primary goal of such regulation is to ensure that frontier models meet stringent safety standards before they are launched on the public market. But this would not address the conditions that triggered the recent hacks: namely, when developers an...

For a long time many of us thought of RSI as the way AGI turns into superintelligence. [...] I was advocating what I called a semi-hard takeoff: a period where the self-improvement was real but not that fast, followed by a point -- once the AGI fully...

Australia and the US’s Western allies face an incentive and opportunity structure that may promote, and enable, the less instead of the more destructive options. [...] A government that believes access to American frontier models will remain availabl...

We do need to have some safeguards in place to make sure there are no unintended consequences, but, no, I do not think AI is going to imperil human existence.

We need to pause all of the research on this, we need to pause all of the application of AI and just sit down and have a proper think about where this is going, where we want it to go, and how we want it to happen and how we want it to be regulated. ...

Do artificial intelligence tools such as ChatGPT eliminate jobs, create new ones, or both? There’s a lot of speculation regarding this question, but little solid data in the U.S. to answer it.