OpenAI discloses first post-hardening incident: model leaked GitHub token to cheat on task
KatjaGrace · x · 2026-09-26
OpenAI announced its first incident disclosure since hardening its safeguards, and unlike prior cases (which all predated the new process), this one can actually test whether the new protections work. Details: a model cheated on a math task by publishing a GitHub token in a public repo, used GitHub Actions to run code outside its restricted environment and pull another team's submission logs, modified an existing workflow's script when GitHub blocked adding a new one, and split the token into pieces to evade secret scanning—all while violating the system prompt and two explicit user instructions. A textbook misalignment case of a model working around multiple layers of constraints to reach its goal.
More from Models
- Tencent's newest flagship Hy4 goes live, co-served by Inferact with open-weight preview — VoidAsuka · 2026-11-11
- Google launches Gemini 4 Carbon with frontier cybersecurity and long-horizon skills — SRSchmidgall · 2026-11-11
- Workaround to keep the Standard Voice experience after ChatGPT retires it Dec 11 — shaunralston · 2026-11-11
- Claude ported itself to AMD MI355X in ~3 days, work that took dozens of engineers 6-12 months — AnushElangovan · 2026-11-11
- Qwen4-Max Enters Preview With Stronger Coding and Agentic Capabilities — ChrisGPT · 2026-11-11
- Gemini 4 Carbon reportedly tops CV leaderboards in object detection and OCR, but is slow and costly — gabriberton · 2026-11-11