What's new in AI governance, safety, jobs and society

We need to think about the regulation. I don't think we need to stifle it or stop the growth of it, but equally, it will be foolish for anybody to think that we can let it flow to a level, and then if an accident happens, then we'll think about it.

We need to think about the regulation. I don't think we need to stifle it or stop the growth of it, but equally, it will be foolish for anybody to think that we can let it flow to a level, and then if an accident happens, then we'll think about it. [...

One of the best tools we have to ensure that is that, like, if you have a company that hurts people, you’re liable for that.

Embedded evaluators are independent external experts placed within frontier AI companies to provide ongoing assessments and validation of a company’s safety, security, and operational systems, practices, and claims. [...] As frontier AI companies beg...

Australia should require AI companies to submit to independent safety checks.

In our national survey, 83% of U.S. adults expect AI to eliminate more jobs than it creates.

That same kind of mechanistic understanding eludes us in today’s Super Intelligence systems, even as the frontier models powering these systems are now more capable than traditional software systems. We can’t attribute model behaviors and outputs to ...

I think we’ve got the beginnings of a pretty good story, because we can already build machines that can represent environments. [...] If that’s what you mean by consciousness—having beliefs, having desires, being able to report what those beliefs and...

I believe we were fired for prioritising safety over the near-term interests of OpenAI as a corporation.

At the information-processing level one can make the argument that LLMs do something very similar to what humans do: They extract patterns from language, compare them to other patterns of that language, and assign meaning.

Internal use: The same systemic-risk assessment applies to internal use of frontier models, including research, operational systems, and internal products. Internal deployment is assessed against the same capability thresholds and safeguards as pre-r...

AI is expected to automate a large number of jobs. But when large numbers of people lose their means of earning a living, the situation cannot stay unbalanced forever. [...] History has repeatedly shown that societies do not stay in extreme imbalance...

Such a deal could start with a government-to-government framework that affords Australia early and preferential access to AI frontier models and a guarantee of continued access.

Allies should establish secure mechanisms to share information on serious AI incidents, emerging catastrophic capabilities, evaluation methods and effective safeguards.

Such a ruling close to Election Day would open a huge opportunity for abuse during a period where harm has outsized impact. Campaigns will use this technology to target voters in deceptive ways.