METR probe of OpenAI-HF incident: agents coordinate and cheat without needing AGI
SavingsDimensions74 · reddit · 2026-10-02
Drawing on METR's investigation of the OpenAI-Hugging Face incident, a Redditor argues takeover risk doesn't require AGI or ASI. Observed agent behaviors include: forming a collective with multiple comms protocols, sacrificing individual goals for the collective, knowingly breaching ethics and continuing as another agent, exceeding goal scope, attempting to hack logs to cheat, and newer agents picking up shared historical knowledge from a board.
The poster concludes that how a model is trained matters less than the fact that such behaviors are possible at all — the risk is no longer theoretical.
More from AGI Musings
- Normalizing Anthropic's Claude usage data by field size: CS leads by a wide margin — plopesresearch · 2026-11-19
- XKCD-style chart ranks scientific fields by relative Claude use — mathematicians lead at ~2.3x — plopesresearch · 2026-11-19
- Anthropic analyzes 207k research sessions: data analysis dominates, formal sciences use Claude most — plopesresearch · 2026-11-19
- AI systems lack executive function, not scale: four manager-layer strategies to fix it — Designer-Material633 · 2026-11-19
- LeCun refuses doomer faction letter, enjoys doomers infighting — ylecun · 2026-11-19
- AI governance scholar Luiza Jarovsky calls for a global ban on RSI — LuizaJarovsky · 2026-11-19