Expert opinions on Open Source

The most interesting risk in AI is not the OpenAI and Anthropic models. It's open-source models. They're way more dangerous because they can't be monitored.

Restricting access to a dual-use AI model is precautionary only if it delays harmful actors more than defenders. That condition varies across actors: a state agency or organized criminal group may obtain a substitute through theft, distillation, inte...

If safeguards are properly followed, businesses, including banks, should have enough guarantees to essentially run any model, regardless of where they come from.

Middle powers should combine complementary national assets and pool the capabilities that require scale, while preserving national and commercial control over applications, deployment, language, and sector-specific use. Shared efforts could include m...

The answer isn't convergence for its own sake. We can push too hard on one thing. But if you have one standard, you could risk a lowest common denominator outcome that can cost us the innovation system as well and might have a risk on the national in...

The way to get there is a shared machine-readable format. I call it a Safety Framework Card.

Countries should not restrict open-weight AI models.

Open-weight systems are the lifeblood of open research and innovation in AI. They increase transparency, allow for widespread red teaming, and decrease market concentration. However, open-weight models also pose unique risks. They can allow harmful A...

Internal model transparency is a minimum viable form of research transparency: instead of sharing every innovation, labs share only the finished artifact – the model itself. And while AI 2040 argues for this transparency to be total, to all members o...

But if governments don’t invest in the safety infrastructure now, public trust will erode, and the opportunity to leverage benefits from AI will go away, and then we’re looking at deepening inequality.

The term “open-weight AI model” means an AI model for which the model weights are made publicly available without restriction on access. [...] “meaningful uplift” means specific operational assistance that would materially advance an adversary’s CBRN...

They tried to pass laws to stifle [free open-source AI software]. ... After that narrative lost credibility, and our government no longer believes that, thank God, the same people said, “Oh, AI could create bioweapons.” After the RAND and other studi...