Anthropic

Advanced AI could pose catastrophic or existential risks to humanity.

We are not sure whether Claude is a moral patient, and if it is, what kind of weight its interests warrant. But we think the issue is live enough to warrant caution, which is reflected in our ongoing efforts on model welfare.

We treat misalignment as a central, but solvable, problem for both us and for the field.

ASL-2 refers to systems that show early signs of dangerous capabilities – [...] give instructions on how to build bioweapons – [...] e.g. a search engine couldn’t.