What's new in AI governance, safety, jobs and society

I don’t see current AI as dangerous. The calls to slow down AI development are a form of marketing and lobbying. Anthropic is portraying AI as highly dangerous to scare governments. But LLMs aren’t at that level yet.

That same kind of mechanistic understanding eludes us in today’s Super Intelligence systems, even as the frontier models powering these systems are now more capable than traditional software systems. We can’t attribute model behaviors and outputs to ...

Specifically my proposal is when an AI autonomously chooses to perform an illegal action the law should hold the AI companies responsible as if they did it intentionally.

I believe we were fired for prioritising safety over the near-term interests of OpenAI as a corporation.

That requires independent evaluators to red-team AI models before deployment, not voluntary company disclosures.

At the information-processing level one can make the argument that LLMs do something very similar to what humans do: They extract patterns from language, compare them to other patterns of that language, and assign meaning.

Internal use: The same systemic-risk assessment applies to internal use of frontier models, including research, operational systems, and internal products. Internal deployment is assessed against the same capability thresholds and safeguards as pre-r...

AI is expected to automate a large number of jobs. But when large numbers of people lose their means of earning a living, the situation cannot stay unbalanced forever. [...] History has repeatedly shown that societies do not stay in extreme imbalance...

Allies should establish secure mechanisms to share information on serious AI incidents, emerging catastrophic capabilities, evaluation methods and effective safeguards.

Such a ruling close to Election Day would open a huge opportunity for abuse during a period where harm has outsized impact. Campaigns will use this technology to target voters in deceptive ways.

The first is a federal governance framework targeting frontier AI developers above $500 million in annual revenue. These developers would be required to publish safety frameworks, report critical incidents, and submit to semi-annual third-party audit...

An opt-out system as proposed by AI companies places burdens and costs on rights holders, as it would require ongoing surveillance to see whether copyright material is being used. We cannot scour the internet and ensure we are opting out on all of th...

For a long time many of us thought of RSI as the way AGI turns into superintelligence. [...] I was advocating what I called a semi-hard takeoff: a period where the self-improvement was real but not that fast, followed by a point -- once the AGI fully...

Australia and the US’s Western allies face an incentive and opportunity structure that may promote, and enable, the less instead of the more destructive options. [...] A government that believes access to American frontier models will remain availabl...

We do need to have some safeguards in place to make sure there are no unintended consequences, but, no, I do not think AI is going to imperil human existence.