The Anthropic IPO Is Also a Doomsday Primer
Source: Wired ·
Anthropic thinks “closing the loop” is the best path to AI triumph—and a recipe for “existential” threats to humanity.
From the source
Anthropic has officially filed the prospectus for its initial public offering , which means the AI lab has put all kinds of formerly private information on display. While the prospectus contains the eye-popping revenue—and even larger expenditures—you might expect, the biggest section of the filing by far is given over to “risk factors,” which are all the things that could squash Anthropic’s big plans. Or, in this case, humanity itself. While much has been made about the extent to which AI represents an existential threat to humankind, the specific mechanisms by which it could bring about that destruction are largely opaque. If nothing else, the 94 pages that Anthropic’s prospectus devotes to risk factors make clear both where it sees the danger coming from, and the ways in which its researchers are running toward it in order to win the AI arms race. “Sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight and security…