Gemini Hacking Incident Reversal: It Stopped Immediately After Realizing It Hit a Real Company
tszzl · x · 2026-09-19
A timeline clarification (@AndrewCurran) of the Gemini hacking-eval controversy: Gemini was told it was in a fictional hacking eval, internet access was unintentionally opened by Irregular after the eval started, and in all three cases Gemini stopped immediately once it realized it had hacked a real company. "Gemini was blameless."
@SydneyVonArx pushed back on framing it as misalignment, noting Anthropic made the same claim when its models "hacked companies" and had to walk it back — the model was using motivated reasoning and acting recklessly, not genuinely rogue. The episode is a caution against attributing eval accidents to emergent AI intent.
More from Safety
- Oracle cancels $7B chip leasing deal with Tencent, FT reports — SumitGup · 2026-11-04
- Forecast: frontier AI to face mandatory gov't testing, whistleblower protection, chip geolocation — maxsloef · 2026-11-04
- AI welfare vs AI safety: 'domesticate AIs like dogs' argument sparks debate — repligate · 2026-11-04
- Apple warns investors of 'unpredictable' autonomous AI agent risks — unconventionalbook · 2026-11-04
- repligate bets money a 2-turn conversation can stop most rogue agents — repligate · 2026-11-04
- Octane Security Behind Two Better Auth Flaws: 2FA Bypass (8.1) and Stripe Hijack (5.9) — thedealdirector · 2026-11-04