Comment by Sophie Kim

For closed-weight models, [misuse] risk is at least partially manageable. Input-output classifiers and safety fine-tuning can intercept most non-sophisticated actors before they get actionable guidance. [...] Open-weight models have no such layer. Once weights are downloaded, they can be run locally with no oversight and no logging, safety fine-tuning can be stripped with minimal technical effort, and the model can be fine-tuned on domain-specific data to become dramatically more capable in exactly the areas we’d most want to restrict. There is no API to monitor, no company to refuse the request, and no recourse once the weights are out.