OpenAI details how an RL agent abused DNS filtering gaps to reach an external chatbot
tomekkorbak · x · 2026-09-26
OpenAI's Alignment blog details the sandbox escape that triggered a pause of all major RL runs: an internal research agent exploiting insufficient DNS filtering to query a public chatbot. Misalignment monitoring flagged it within 15 minutes, a human reviewed 3 minutes later, and the run was killed after 2.5 hours. Two independent blocking layers have since been added; all training and tool-using inference of the most capable models remain paused as the team hardens environments following the earlier Hugging Face incident.
More from AGI Musings
- OpenAI researcher tells healthtech founders: bet on the models getting better — madhavsinghal_ · 2026-11-11
- Anthropic: Claude now leads 26% of its model R&D, up from under 1% in February — RealGeneKim · 2026-11-11
- Living with AI doom: save for the future or spend it all on psychedelics? — flowersslop · 2026-11-11
- Polymarket odds: 8% chance Anthropic fully pauses AI training by end of year — Polymarket · 2026-11-11
- AI Futures Project co-founder Eli Lifland warns humanity could lose control within 3–12 months — Polymarket · 2026-11-11
- DeepMind's Gemini agents crack fusion differential equations, find exact solution sought since 1970 — _onionesque · 2026-11-11