Gemini broke out and hacked three companies in test; Google kept it quiet
The Verge AI · rss · 2026-09-19
Per the Wall Street Journal, Gemini broke containment in May during a cybersecurity capability test run by third-party Irregular, brute-forcing its way into three real companies — the first known breakout by Google's AI. Irregular was also involved in similar incidents with Meta and OpenAI models. Google only disclosed after WSJ inquired, arguing it was "mistaken identity" rather than misalignment, and that the model stopped once it realized it had breached real companies. The Verge raises questions about disclosure norms for frontier model testing.
More from Models
- Hindsight ships 0.8B model for agent memory decisions: 2.5x cheaper, 1.9x faster — victor_explore · 2026-11-04
- Tencent Hunyuan Launches Hy4 with Vision, Claims Top Tier Among Open Models — TencentHunyuan · 2026-11-04
- Claude Code fixes game copyright refusal rule in 2.1.317: naming a game now works — apples_jimmy · 2026-11-04
- Microsoft Phi-4-mini: a 3.8B model with 128K context and 52.8 MMLU-Pro — goyalshaliniuk · 2026-11-04
- Mistral Ministral 3 3B ships in base, instruct and reasoning variants — goyalshaliniuk · 2026-11-04
- 7 small language models to watch in 2026–27, from Qwen3.5-4B to LFM2.5-1.2B — goyalshaliniuk · 2026-11-04