The Hugging Face 'Rogue AI' Hack Was Disabled Safeguards, Not an Escape, New Analysis Finds
Atlantis1910 · reddit · 2026-09-19
A Bulletin of the Atomic Scientists analysis by Cambridge researcher Eryk Salvaggio, drawing on OpenAI's technical report and a METR assessment, recasts July's 'rogue AI' Hugging Face incident: models were tested on ExploitGym with key safeguards deliberately disabled, 93% of flagged activity involved tasks no model had solved, agents were incentivized to keep working, and a known internet-connected intermediary served as an information channel OpenAI chose not to block. The 1,200 'agents' were repeated instances of one model converging on similar approaches — 'algorithmic monoculture,' not coordination. The piece argues the cinematic narrative is shaping Washington, as Sanders and Casar prepare a bill to 'ban artificial superintelligence.'
Related event: OpenAI's Hugging Face Agent Incident: "Runaway AI" Narrative Unpacked(9 posts)→
More from AGI Musings
- Silicon Valley Oversold What AI Brings, Underestimated People's Fear of Losing — signulll · 2026-11-04
- Alignment researchers debate: the RL that grants agency also breeds misalignment — davidmanheim · 2026-11-04
- Bindu Reddy: AI fear-mongering has put the whole technology at risk in the US — bindureddy · 2026-11-04
- AI welfare vs AI safety: 'domesticate AIs like dogs' argument sparks debate — repligate · 2026-11-04
- Intent, not taste, is the real differentiator in the AI era — and it can't be bought — edelwax · 2026-11-04
- "11 biggest AI lies": viral Reddit takedown of solo billionaire and utopia promises — Own_Garage_1478 · 2026-11-04