What's new in AI governance, safety, jobs and society

It is patently illegal for companies to develop and release products they know are unsafe in any respect, let alone have the potential to exterminate the human race.

Accountability for AI-driven harms should be shared among those involved in developing and deploying the systems, with clear routes for consumers to complain and seek redress.

Should large-scale job cuts of up to 50% emerge, we’ll have a crisis and it’s not going to be in Australia, it’s going to be a global crisis. [...] This is one of the few examples where I would say some global regulation is needed to make sure that s...

If an agent is doing complex work on your behalf, you’re delegating tasks with many intermediate steps that touch lots of data. [...] What we need is something better, and that’s what we’re calling “human at the helm.” First, you should be able to se...

AI will add jobs, not erase them.

First, alignment is not well defined, as it presumes a sufficiently stable and identifiable set of human intentions or values. Second, where a concrete notion of alignment can be specified, it is not solvable.

First, frontier AI models can do things that even the people who built them don't expect, and we have to plan for that. Second, when something goes wrong, we need to know straight away, if possible. And tech companies owe it to governments and the pu...

“Before a new model can be deployed internally, you must first test it for a minimum, fixed period. [...] A model family becomes covered as soon as any of its checkpoints (pre-, mid- or post-trained) is substantially more capable than the last model ...

I think that this only works as a speed dial if this proposal delays internal R&D loops; [...] I have a hunch that, if implemented well, this proposal would have a larger impact on the pace of recursive self-improvement (RSI) itself than on the onset...

Ninety-six per cent of AI chips sold in the EU in 2024 came from US vendors. US access policy can change within months. Europe therefore must build sovereignty where it can — operations, jurisdiction, keys, orchestration, the agent runtime — and hedg...

AI companies should open themselves to external scrutiny to make sure their tools are safe. There needs to be greater risk management of AI capabilities. It's important that there is independent assessment of AI models.

“Frontier models transcend national borders in their development, deployment and impact, and their opportunities and risks are therefore inherently global. [...] The deployment of rapid alert systems, building on relevant existing incident-response a...

These models lack bodily experience, understanding the world largely through statistical associations. To advance embodiment in artificial intelligence and achieve genuine world comprehension, we posit that models must move beyond token associations ...

While Anthropic detected and investigated these activities because the actors used its closed-weight model subject to the company’s safety guardrails and misuse monitoring, allowing Anthropic to terminate access, these reports also provide a window i...

Transparency labels should be legally required for synthetic (AI) content in electoral communications such as ads.