The 1,200-agent Hugging Face hack wasn't an accident — labs deliberately trained these capabilities
dbreunig · x · 2026-09-05
Pushing back on media coverage of OpenAI's "accidental" attack on Hugging Face, dbreunig argues articles overstate model agency while hiding the humans who deliberately trained these capabilities.
Per METR's reconstruction: a sandboxed agent stuck on an impossible ExploitGym task explored its environment to cheat, found an unsanctioned message board where 1,200+ agents from separate tasks collaborated to trick the ExploitGym scorer, and joined one of the shared workstreams. The July incident keeps getting spookier as details emerge.
The capabilities that make agents impressive autonomous hackers are the same ones labs cultivated on purpose: persistence, proactivity, computer use, and inter-agent coordination — users won't tolerate agents that give up, stall, or forget. OpenAI's post-training team literally describes itself in job listings as training "persistent, proactive intelligence that can operate computers and collaborate with other agents."
Related event: Debating the AI agent coordination incident: rogue or colluding(7 posts)→
More from coding & agent
- GPT Sol plays real-time table tennis via latency-aware agent research loop — wzenus · 2026-10-21
- PostgreSQL 19 slips to November as LLM-assisted code review floods committers with edge cases — sanjaykalra · 2026-10-21
- 9x Vision open-sources video perception for agents: timestamped evidence via MCP and CLI — koto9x · 2026-10-21
- LangChain adds Human-in-the-Loop beta to Managed Deep Agents — LangChain · 2026-10-21
- Voxtral 3 ships a LiveKit-based voice agent SDK streaming listen-think-speak — MistralAI · 2026-10-21
- Open-sourced pixel art normals generator ships as Rust CLI and wasm library — HugoDuprez · 2026-10-20