OpenAI's New Tech Reportedly Degrades CoT Monitorability, Sparking Fierce AI Safety Debate

A report by The Information that OpenAI's new technology reduces chain-of-thought (CoT) monitorability has triggered a multi-day, high-intensity debate in the AI safety research community. The core dispute: whether CoT monitoring was ever reliable, whether mechanistic interpretability can replace it, and when—if ever—it should be abandoned. DeepMind interpretability researcher Neel Nanda forcefully pushed back against the increasingly popular view that interpretability will eventually fill the gap. This is the first large-scale public challenge to CoT monitoring as a key frontier-AI-safety tool, and matters to anyone following model governance and interpretability.

Confirmed

• Per The Information (relayed by Gary Marcus, who urged readers to reread the 2025 paper "Chain of Thought Monitorability: A New and Fragile Opportunity"), OpenAI's new technology reduces CoT monitorability.
• Neel Nanda called the view that CoT need not stay monitorable "total nonsense," arguing CoT is a vital part of current safety; losing monitorable CoT would be a safety tragedy, and interpretability is no excuse to abandon it. Responding to @bendee983, he clarified that "CoT is imperfect" does not mean it is not our current best tool or lacking safety value.
• Anthropic interpretability researcher jachiam0 argued CoT fidelity is inherently fragile and should never have been a long-term safety backstop; protecting fidelity has value but "CoT must be human-readable" should not be a principle.
• Researcher thlarsen warned that we are losing the channel of reading CoT to detect misalignment; with hidden CoT, investigation would rely on tool calls and agentic behavior and require trusting AI self-reports, with progress possibly faster than AI-2027-style scenarios.
• Anthropic's Jack Lindsey said white-box methods (e.g., activation decoding) are unlikely to match CoT monitorability within a year—though he is optimistic about "a few years," with two activation-decoding techniques already in production monitoring. Ryan Greenblatt likewise doubts strong, genuinely usable mechanistic-interpretability monitors within a year.
• This timeline was directly challenged by tszzl, who predicts mechanistic-interpretability monitors Pareto-dominating CoT monitors within a year, arguing monitorability is an invariant that must be maintained (a personal view, not an OpenAI alignment team position). nablatheta also thinks mech interp falls short within a year.
• Ex-Anthropic's Nick Cammarata said the erosion of CoT monitoring is unfortunate and should be resisted, but interpretability is what will truly reveal what networks do.

Unconfirmed

• What OpenAI's new technology actually is, and the extent of its impact on CoT readability, remain unspecified beyond the report.
• Whether mech interp can surpass CoT monitoring within a year is disputed among researchers with conflicting predictions.

Why it matters

• The debate is fundamentally a trade-off between safety redundancy and model performance. yonashav, Gary Marcus, and Nanda argue that abandoning a useful interim tool before a proven replacement exists is unreasonable—Marcus called kicking away the rickety scaffolding without a better alternative madness; Micah Carroll noted alternatives may not be ready within months.
• maksymandr laid out post-CoT options (action-only monitors, probe-based monitors, activation-level monitors), while Zack Korman offered the reverse: monitor real-world effects directly rather than model internals.
• If CoT readability keeps degrading, labs and governments lose much of their ability to detect and verify misalignment—the exact risk warned of by the CoT Monitorability paper authors, including Bengio.

2026-09-02 ~ 2026-09-04 · 40 related posts

Full story(3 episodes)→

• Episode 1: Anthropic Paper Sparks Debate Over Reliability of CoT Monitoring(2026-09-01, 2 posts)
• Episode 2: OpenAI's New Tech Reportedly Degrades CoT Monitorability, Sparking Fierce AI Safety Debate(2026-09-02, 40 posts)
• Episode 3: Looped Transformer Rumors Spark Fierce Debate Over CoT Monitorability(2026-09-04, 7 posts)

• Opinion: Forcing Legible CoT Might Weaken LLM Alignment — JacquesThibs · 2026-09-02
• Hiding CoT makes AI alignment investigation nearly impossible — thlarsen · 2026-09-02
• Debate: Is abandoning CoT monitoring justified because it will eventually fail? — yonashav · 2026-09-02
• Gary Marcus: Removing fragile CoT scaffolding is insane — GaryMarcus · 2026-09-02
• Opinion: Abandoning CoT Monitoring for Latent Reasoning is Inevitable — Darpinian · 2026-09-02
• Models are far from out of control; HF incident was unnoticed, not malicious — Darpinian · 2026-09-02
• Anthropic's Darpinian: malicious humans abusing models beat loss-of-control risks — Darpinian · 2026-09-02
• CoT monitoring may fail: misaligned AI gets harder to detect, outpacing AI 2027 — AaronBergman18 · 2026-09-02
• Researcher worries about decreasing CoT monitorability trend — tomekkorbak · 2026-09-02
• [source] Prediction: Mechanistic Interpretability Will Surpass CoT Monitoring — tszzl · 2026-09-02
• Any Circuit Computation is Neuralese, Says OpenAI Staffer — tszzl · 2026-09-02
• Mechanistic interpretability monitoring to surpass CoT in a year — aiamblichus · 2026-09-02
• MechInterp unlikely to replace CoT monitoring in a year — nabla_theta · 2026-09-02
• Critique of CoT Monitorability: Mech Interp Makes More Sense — scaling01 · 2026-09-02
• Ryan Greenblatt doubts working mech interp oversight arrives within a year — connoraxiotes · 2026-09-02
• Chain-of-thought legibility was always doomed as a safety backstop, researcher argues — zetalyrae · 2026-09-02
• Anthropic researcher: CoT legibility is doomed as a long-term AI safety backstop — inductionheads · 2026-09-02
• Researcher bets frontier model forward passes are approaching neuralese circuit computation — EigenGender · 2026-09-02
• Beyond CoT monitoring: action monitors, probes, and activation oracles as defense layers — maksym_andr · 2026-09-02
• [source] White-box monitoring won't match CoT monitorability within a year, researcher says — Jack_W_Lindsey · 2026-09-02
• Readable CoT was tea leaves anyway: safety methods that break on architecture changes were never reliable — juliusadml · 2026-09-03
• OpenAI's CoT monitorability hit: paper authors double down on 'fragile' AI safety window — GaryMarcus · 2026-09-03
• Why CoT interpretability was never a real audit trail — and what a stronger safety substrate looks like — GaryMarcus · 2026-09-03
• White-box methods won't match CoT monitoring within a year, researchers debate — tszzl · 2026-09-03
• Researchers debate CoT monitorability: what replaces it when CoT goes away? — LauraRuis · 2026-09-03
• Nick Cammarata: CoT monitoring is starting to fail, but interpretability has never looked brighter — nickcammarata · 2026-09-03
• Boaz Barak: abandoning chain-of-thought before validated alternatives is irresponsible — inductionheads · 2026-09-03
• CoTs alone aren't sufficient, but removing explicit reasoning weakens defence-in-depth — schwarzjn_ · 2026-09-03
• Safety researchers: OpenAI has abandoned chain-of-thought fidelity, and CoT was never a real safeguard — schwarzjn_ · 2026-09-03
• Researchers: AI labs have dramatically underinvested in action-only monitors as CoT oversight fades — maksym_andr · 2026-09-03
• Open questions in action-only AI monitoring: intelligence gap, test-time compute, sync limits — xeophon · 2026-09-03
• [source] Neel Nanda: Losing Monitorable Chain of Thought Would Be a Safety Tragedy — NeelNanda5 · 2026-09-03
• Researchers push back: chain-of-thought remains our best current safety and interpretability tool — MoonL88537 · 2026-09-03
• DeepMind's Neel Nanda Pushes Back on CoT Critics: Imperfect but Still Our Best Safety Tool — NeelNanda5 · 2026-09-04
• Neuralese explained: why OpenAI's Astra architecture has safety researchers alarmed — ShakeelHashim · 2026-09-04
• You don't need CoT to detect AI harm — just monitor the real world — ZackKorman · 2026-09-04
• Neel Nanda slams research making agent communication harder to monitor as interp goals drift — akbirthko · 2026-09-04
• AI safety researcher: monitoring the real world, not CoT, is the only durable harm-detection layer — gandamu_ml · 2026-09-04

2 near-duplicate retellings: hunarbatra · NeelNanda5