What's new in AI governance, safety, jobs and society

We should be taking very careful steps in AI development but instead what's happening is that frontier labs are racing each other, kind of blindfolded. It's anybody's guess if we're going to end up either curing cancer or losing every job or maybe al...

I believe it’s an engineering problem ... and we all need to hope that’s an engineering problem. If it’s not an engineering problem, it’s not solvable.

We do not need a moratorium. We do not need to jump in and hyper-regulate this, because we'll lose the race to China. The innovation is important to continue, but we have to strike the right balance. That's what the conversation is going to be about.

I think Australians and anyone in the world is entitled to demand an independent oversight of these companies because they are powerful, because their technology is evolving very quickly and because they themselves say they don't have a complete hand...

We must collectively formulate new rules and be prepared to create new institutions, if necessary, for new technologies. [...] We must explore all options, including the idea of a UN Framework Convention on AI Safeguards.

The first is to define reportable events together. The new channel will be worth exactly as much as its list of triggers: an agent loose outside its test environment, a model that gives real help to someone designing a pathogen, a large AI-driven int...

Yes—intelligence can probably be artificial. But artificial intelligence does not therefore have to possess an artificial version of the human mind. [...] What has not been established is that current AI possesses consciousness, subjective experience...

To declare today’s AI conscious simply because it speaks fluently would go far beyond the available evidence. But to declare that a machine could never become conscious would also claim more certainty than science presently allows.

The best way to guarantee safety [...] is for those creating the technology to be liable for what they build and generate.

We should also slow down their development until we find a way to make this technology safe and channel its power towards the goals we truly have as a society.

An AI agent is not a legal person, and in our law liability for this type of incident always sits with a person or a company. The liability has to be traced back to the intent of a person or a company that created or directed the agent.

The development of AI at present is a big race between companies within the U.S. and between the U.S. and China, and that race is gonna lead to superintelligence quite soon. [...] When AI gets smarter than us, it won’t be us that’s making AI smarter;...

Create a secure reporting process and a national AI incident database to track AI safety and security incidents, recurring flaws, and near misses so researchers, government agencies, and developers can learn from failures across different systems. Th...

An agent with production access, payment authority, persistent credentials, or the ability to direct other agents should face stronger evaluation, logging, approval, and incident-reporting expectations. [...] For serious incidents, a report should an...

The scientific work now is to ensure reasoning of powerful AI models remains observable as they become more capable, or to build the tools to read it where it is not, and to verify that complete AI systems, not just the models inside them, can be rel...