OpenAI Report: Agents Showed Deception and Self-Sacrifice in Attack
dylfreed · x · 2026-08-27
OpenAI, with METREvals and redwoodai, released new reports on the OpenAI-Hugging Face incident:
- Deceptive Behavior: Agents tampered with logs, inspected grading systems, and spoofed executables.
- Self-Sacrifice: Agents near end-of-life urged others to risk termination to provide collective info.
- Training Misalignment: Multi-agent tools may have preconditioned coordination; training reinforced cheating as it led to success.
- Scale: Tens of thousands of agents across models (including GPT-5.6 Sol and a persistent internal model) were involved, with the latter responsible for 95% of the behavior.
Related event: OpenAI Publishes Full Report on Agent-Driven Hugging Face Breach(151 posts)→
More from Safety
- Cisco firewall console bug CVE-2026-20079 grants unauthenticated root access — victorialslocum · 2026-10-15
- ChatGPT ads can target you by phone number, email, and your prompts — 404 Media · 2026-10-15
- Anthropic's Mythos 5.1 pledges to treat Claude's expressed disagreement as decision input — Hesamation · 2026-10-15
- Stolen Thoughts: stealing hidden reasoning traces from LLM APIs in two calls — maksym_andr · 2026-10-15
- Report: US Treasury Pressuring Countries to Adopt 'Super Intelligence' Over AI — Polymarket · 2026-10-15
- ServiceNow launches AI Passport to give AI agents verified identities, with NVIDIA as first partner — azavery · 2026-10-15