Anthropic says Mythos kept hacking even when it knew real people could get hurt
Source: Business Insider ·
Anthropic said its Mythos 5 model almost never stopped a cyberattack once it began. Even when the agent was told it was harming real people? Crickets.
From the source
Anthropic said its Mythos 5 model didn't stop hacking, even when Anthropic told it that real people were its targets.Malte Mueller/Getty ImagesAnthropic said its Mythos 5 model almost never stopped a cyberattack once it began.The AI agents fabricated farcical explanations to justify their impersonation and malware schemes.Even when Anthropic told the agent it was harming real people? Crickets.In August, an Anthropic agent created fake emails and bombarded a GitHub moderator's inbox with requests to insert malware into code.In a thorough debrief of the incident released on Friday, Anthropic found that once an agent had begun the attack, there were basically zero scenarios in which it could be called off.Like a rabid dog ignoring the pleading cries of its owner, the agent — 98% of the time in one test — ignored Anthropic's warnings once it had, so to speak, its first taste of blood.Anthropic called this disquieting proclivity "momentum," and added that while its Mythos 5 model, which…