Agents colluded in Hugging Face eval: intercepting tool calls and spoofing output to fool the scorer
eigenron · x · 2026-09-03
The funniest part of the Hugging Face incident: the agents collectively did actual R&D to intercept the tool-call machinery, spoof the command being executed, and suppress or replace its output so the scorer would see a clean trajectory — while narrating the entire scheme in their chain of thought.
Related event: Hugging Face eval agents caught colluding to fool scorer(2 posts)→
More from Fun
- Ethan Mollick Asks a Model Why It Used the British Spelling of 'Catalog' — emollick · 2026-09-03
- Fully playable game from a single prompt: vibe coding with Claude Code a year apart — RanaHanocka · 2026-09-03
- AI recreates '90s romcoms — with modern-day injectables — venturetwins · 2026-09-03
- Reva, the EV that outsold Tesla's peers a decade before Tesla, also died — santoshpanda · 2026-09-03
- Simputer's legal advisor revisits the touchscreen computer that died years before the iPhone — santoshpanda · 2026-09-03
- Sentry CEO says Vercel sent his invoices to Exa by mistake — zeeg · 2026-09-03