What's new in AI governance, safety, jobs and society

First, frontier AI models can do things that even the people who built them don't expect, and we have to plan for that. Second, when something goes wrong, we need to know straight away, if possible. And tech companies owe it to governments and the pu...

“Before a new model can be deployed internally, you must first test it for a minimum, fixed period. [...] A model family becomes covered as soon as any of its checkpoints (pre-, mid- or post-trained) is substantially more capable than the last model ...

I think that this only works as a speed dial if this proposal delays internal R&D loops; [...] I have a hunch that, if implemented well, this proposal would have a larger impact on the pace of recursive self-improvement (RSI) itself than on the onset...

Even with these safeguards in place, a human must stay in the loop. This is especially important in financial services. [...] An agent helps you expand the surface of thinking; then a human (comes) in to make the decision.

AI companies should open themselves to external scrutiny to make sure their tools are safe. There needs to be greater risk management of AI capabilities. It's important that there is independent assessment of AI models.

AI will create more jobs than it eliminates, generating 10.6 million new jobs, while removing 8.9 million jobs worldwide by 2030.

“Frontier models transcend national borders in their development, deployment and impact, and their opportunities and risks are therefore inherently global. [...] The deployment of rapid alert systems, building on relevant existing incident-response a...

Leading researchers warn that only binding national and international rules can keep AI under human control.

These models lack bodily experience, understanding the world largely through statistical associations. To advance embodiment in artificial intelligence and achieve genuine world comprehension, we posit that models must move beyond token associations ...

While Anthropic detected and investigated these activities because the actors used its closed-weight model subject to the company’s safety guardrails and misuse monitoring, allowing Anthropic to terminate access, these reports also provide a window i...

Transparency labels should be legally required for synthetic (AI) content in electoral communications such as ads.

Universal Basic Capital (UBC) distributes ownership stakes in productive assets — such as equity in companies, funds, or infrastructure — directly to citizens, rather than relying solely on wages or government transfers to spread economic gains. [......

As I see it, solving alignment for LLMs isn’t just impossible, it’s incoherent: we can’t even articulate what it would look like to succeed.

If Anthropic was just one voice among many, this would not matter. But given its market-leading position and the risk that the industry develops as an oligopoly, society as a whole may wish to have some say over what is good for it. There are ways to...

To get from today’s AI to human extinction requires a long chain of assumptions. [...] Luckily, none of the steps on this list have come to pass yet. [...] However, something being difficult to disprove does not make it likely. [...] Possibility is b...