Expert opinions on Open Source

Nefarious actors can use open models maliciously, [...] whereas developers of closed models have more means to identify and disrupt this malicious use.

These studies, on their own, are insufficient evidence to demonstrate increased marginal societal risk from open foundation models.

Transparency is the greatest safeguard. [...] When codes are open and shared, millions of young minds can make them safer and better.

platforms that host libraries of open-source AI models to ensure that models are uploaded with appropriate system and safety information

I do not believe this is the best approach to protecting the public from real threats posed by the technology.

However, it is important to differentiate regulating applications (which we need) vs. regulating the technology (which is ill-advised).

When you open source a big model and give people the weights [...] You get people using that open source model and training it, refining it to do something bad like cyberattacks or making biological weapons because it's much easier to refine the mode...

there has to be full open source here. [...] if you're worried about AI-generated pathogens, [...] Let's do a Manhattan Project for biological defense.