What's new in AI governance, safety, jobs and society

As AI becomes more autonomous the real question for business leaders is where human judgment matters most. What should machines be allowed to do independently? What should trigger human intervention? And who remains accountable for the outcome? [...]...

How AI can really have a devastating impact if we do not have the guardrails, we do not have a framework that really guides the operation, the development and the spread of AI. This is a matter that has been raised not only by governments but also by...

At the same time, the rapid development of frontier AI models poses serious risks to safety and security if not appropriately managed. [...] We therefore welcome the recently launched initiatives that aim to manage the risks related to frontier techn...

A better approach would be risk-based. Low-risk applications need little intervention, while systems crossing defined thresholds in areas such as cyber capability, biological risk, weapons, critical infrastructure or autonomous action should face muc...

Amodei’s best idea is to give outside evaluators employee-level access to the labs. That only works if the evaluators answer to the public.

The first is the danger that AI becomes so capable that humans lose control of it. This is the existential-risk scenario that dominates Silicon Valley’s safety debate. The ultimate threat is not China, the US or any particular lab. Rather, it is an a...

Before, or concurrently with, deploying a new frontier model or a substantially modified version of an existing frontier model, a large frontier developer shall include in the transparency report required by paragraph (a) of this subdivision, summari...

It seems likely that the answer looks more like setting standards for other businesses while ensuring courts and attorneys general hold AI businesses liable for foreseeable uses of their technology—including enforcing existing laws about hacking and ...

Artificial intelligence (AI) is moving recruitment from a largely human-administered process toward a socio-technical decision system in which algorithms source, rank, screen, assess, and recommend candidates. [...] It advances a risk-calibrated mode...

The act will employ the precautionary principle to prohibit the introduction of AI tools into high-risk settings, such as education, health care or the delivery of public services, unless there is clear evidence that they will not cause harm. Where h...

As the frontier models become more capable, these risks have come more sharply into focus. Models being developed will allow hacking on a level we never thought possible. And they will soon be in the hands of adversaries who see the world very differ...

That is why scientists around the world have been calling for a CERN-like international AI-research agency for nearly a decade. To date, several half-measures in this direction have been launched. But none come close to establishing a well-funded, lo...

I believe we're there now, and I believe the current models will take us there. The future is just so amazing that we are lucky enough to be born at this moment of time, right when everything is like bursting into a big bang of consciousness.

All of this seems great to me, and there are some things that I'm especially happy to see. Specifically, point number two: “The idea of model welfare is wrong. AIs should not have rights or legal personhood.”

Today, the companies are being built elsewhere. Last year the United States produced 59 notable AI models and China produced 35. France and the United Kingdom produced one each. Along the rest of the AI value chain, the picture is the same: the Unite...