OpenAI's CoT monitorability hit: paper authors double down on 'fragile' AI safety window
GaryMarcus · x · 2026-09-03
Following The Information's report that OpenAI's new techniques reduce chain-of-thought monitorability, Gary Marcus urged readers to revisit the 2025 paper "Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety" (co-authored by Yoshua Bengio, Beth Barnes, Neel Nanda and others). Its core claim: CoT monitoring is imperfect and lets some misbehavior slip through, but it's a promising oversight method worth investing in. Co-author Tomasz Korbak reaffirmed the paper's stance that monitorability is fragile yet preservable.
More from Safety
- One diagram explains the difference between CSRF and XSS attacks — _jaydeepkarale · 2026-10-18
- Grady Booch slams Anthropic for tolerating up to 50 deaths and $1B damages per model — Grady_Booch · 2026-10-18
- Single Neuron Suffices to Bypass Safety Alignment in LLMs, Paper Finds — burny_tech · 2026-10-18
- Polymarket gives OpenAI just 8% odds of a full training pause by end of 2026 — Polymarket · 2026-10-18
- OpenAI engineer over alleged hidden recording device seeks bail, denies Saudi escape plan — Polymarket · 2026-10-18
- Free comic "The Collective" offers a strange retelling of the Hugging Face hack — Flugelwagen · 2026-10-18