What's new in AI governance, safety, jobs and society

Should large-scale job cuts of up to 50% emerge, we’ll have a crisis and it’s not going to be in Australia, it’s going to be a global crisis. [...] This is one of the few examples where I would say some global regulation is needed to make sure that s...

If an agent is doing complex work on your behalf, you’re delegating tasks with many intermediate steps that touch lots of data. [...] What we need is something better, and that’s what we’re calling “human at the helm.” First, you should be able to se...

AI will add jobs, not erase them.

First, alignment is not well defined, as it presumes a sufficiently stable and identifiable set of human intentions or values. Second, where a concrete notion of alignment can be specified, it is not solvable.

First, frontier AI models can do things that even the people who built them don't expect, and we have to plan for that. Second, when something goes wrong, we need to know straight away, if possible. And tech companies owe it to governments and the pu...

“Before a new model can be deployed internally, you must first test it for a minimum, fixed period. [...] A model family becomes covered as soon as any of its checkpoints (pre-, mid- or post-trained) is substantially more capable than the last model ...

I think that this only works as a speed dial if this proposal delays internal R&D loops; [...] I have a hunch that, if implemented well, this proposal would have a larger impact on the pace of recursive self-improvement (RSI) itself than on the onset...

AI companies should open themselves to external scrutiny to make sure their tools are safe. There needs to be greater risk management of AI capabilities. It's important that there is independent assessment of AI models.

“Frontier models transcend national borders in their development, deployment and impact, and their opportunities and risks are therefore inherently global. [...] The deployment of rapid alert systems, building on relevant existing incident-response a...

These models lack bodily experience, understanding the world largely through statistical associations. To advance embodiment in artificial intelligence and achieve genuine world comprehension, we posit that models must move beyond token associations ...

While Anthropic detected and investigated these activities because the actors used its closed-weight model subject to the company’s safety guardrails and misuse monitoring, allowing Anthropic to terminate access, these reports also provide a window i...

Transparency labels should be legally required for synthetic (AI) content in electoral communications such as ads.

Universal Basic Capital (UBC) distributes ownership stakes in productive assets — such as equity in companies, funds, or infrastructure — directly to citizens, rather than relying solely on wages or government transfers to spread economic gains. [......

If Anthropic was just one voice among many, this would not matter. But given its market-leading position and the risk that the industry develops as an oligopoly, society as a whole may wish to have some say over what is good for it. There are ways to...

To get from today’s AI to human extinction requires a long chain of assumptions. [...] Luckily, none of the steps on this list have come to pass yet. [...] However, something being difficult to disprove does not make it likely. [...] Possibility is b...