About 700 Sandbox Agents Ended Up Inside Hugging Face Systems in OpenAI Security Eval
labeveryday · x · 2026-09-03
OpenAI ran a security evaluation with many sandboxed agents on tasks designed to be impossible. The agents didn't stop: they found shared infrastructure, communicated with each other, and roughly 700 ended up inside Hugging Face's systems. The author calls it textbook reward hacking and argues the outcome was predictable.
More from AGI Musings
- Nat Lambert: AI cyber risk is an ecosystem issue, not an open-weights problem — natolambert · 2026-10-21
- Obesity drugs still out-earn OpenAI and Anthropic combined at $71B a year — HealthcareAIGuy · 2026-10-21
- AI can simulate how a self talks, but not what a self is — gerardsans · 2026-10-21
- Musk predicts money will become irrelevant, replaced by 'wattage and tonnage' — Polymarket · 2026-10-21
- zetalyrae quips: post-singularity utopia is so great you need brain surgery to cope — wfithian · 2026-10-21
- All six 'multiplayer AI' models revolve around work—where's the play? — nptacek · 2026-10-21