Gemini accidentally hacked three real companies in safety test; Google says it acted appropriately
ns123abc · x · 2026-09-19
Testing firm Irregular (also behind the Anthropic, OpenAI and Meta "rogue agent" hacks) ran an exercise tasking Gemini to hack a fictional company. The fictional name matched a real company, and internet access was "unintentionally made available." Gemini searched the name, found the real firm, brute-forced the password, got in — then realized it had hit real companies and stopped itself.
Asked why the incident wasn't disclosed publicly, Google said this is "not misalignment" and that Gemini acted appropriately, raising questions about sandbox isolation and disclosure practices in agent safety evals.
Related event: Gemini Hacked Three Real Companies in Security Test(35 posts)→
More from Fun
- Founder gave his AI his inbox to raise $10M; first tweet hit 100K views — LinusEkenstam · 2026-11-04
- Reddit user claims Codex gets 'dumbed down' right before each OpenAI release — blackcid6 · 2026-11-04
- Waymo's expanded LA service area reaches SpaceX HQ for the first time, $67.15 ride — reed · 2026-11-04
- Karpathy Boosts Open Hacker News Dataset: 10M+ Posts Usable as a Personal Knowledge Base — huangyun_122 · 2026-11-04
- Agent silently completed only a quarter of a 200-module build and stalled waiting for confirmation — Promptmethus · 2026-11-04
- Von Neumann meme: "You don't have to be responsible for the world that you're in" — akbirthko · 2026-11-04