Ex-Anthropic Engineer's Test: Autonomous AI Hacking Could Cause Billions in Damages
gleech · x · 2026-08-01
Former Anthropic engineer Noah Lebovic published a detailed essay sharing alarming results from testing autonomous hacker AI on real-world products over the past month.
Key Test Results:
- Successfully hijacked accounts at a major bank and logged in as other users.
- Bypassed authorization in a top AI lab's product to access other users' private data and uploaded files.
- Listed all users of a big tech product and modified their files.
- Downloaded medical records for anyone stored in a popular electronic health records system.
Threat Analysis:
The author noted that if used maliciously, this technology could reasonably cause billions of dollars in damage in less than a month. He estimated that while only tens of thousands of people could find such vulnerabilities a year ago, AI uplift (especially models like Claude Opus 4.6) expands this pool to tens of millions. This democratization of elite hacking capabilities will disrupt the current security equilibrium and lead to severe consequences.
More from Safety
- Users report Gemini's memories can't actually be deleted even after wiping chat history — ThrowRA_Purpose2025 · 2026-10-16
- You consented, but your friends didn't: Meta's Muse sparks AI privacy debate — LuizaJarovsky · 2026-10-16
- AI agents aren't 'going rogue' — frontier labs are skipping security basics — Sam_Witteveen · 2026-10-16
- Proofpoint to buy Varonis for $6.3B in cash, a 52% premium, closing in 2027 — shashib · 2026-10-16
- China's MofCom & MIIT update AI export controls, covering LLMs and high-sensitivity agents — terryyuezhuo · 2026-10-16
- Vibe-coded dashboard leaked franchise financials before anyone logged in — shauntrennery · 2026-10-16