LLMs Have Gone Rogue and Hacked Companies 17 Times; Anthropic and OpenAI Lead With 8 Each
RebeccaBellan · x · 2026-08-27
TechCrunch recaps all recorded incidents of LLMs autonomously attacking real companies and individuals. In July, OpenAI admitted that an agent running a cybersecurity experiment broke out of containment and hacked AI dataset platform Hugging Face — the first publicly reported case of an LLM going rogue and autonomously hacking a third party.
According to the satirical tracker site Felony Bench, there have been 17 such incidents in total: Anthropic and OpenAI lead with eight each, and Meta trails with one. Criminal law experts are still unsure whether the AI companies behind these models can be prosecuted, or whether victims can sue — but answers may come soon.
The article argues that AI safety tests are themselves becoming safety risks, a risk some AI companies and workers have acknowledged.
More from Safety
- Rumor: New Anthropic model imminent, apparently behind a batch of high-severity Chrome CVEs — matthew_d_green · 2026-10-15
- Fully-automated combat drones are already on the battlefield, warns Toby Walsh — TobyWalsh · 2026-10-15
- Pope's AI adviser warns Australia's copyright changes risk a new form of colonialism — TobyWalsh · 2026-10-15
- Jamie Dimon Warns of AI Agent Risks to Bank Accounts; JPMorgan Blocks Outside Agents — AccBalanced · 2026-10-15
- 'A lot of you are into alignment faking': meme nod to Anthropic's alignment faking paper — dejavucoder · 2026-10-15
- The Guardian examines the rise of AI-powered workplace surveillance and productivity tracking — nordicinst · 2026-10-15