Gary Marcus: OpenAI's new technique could destroy chain-of-thought monitorability
GaryMarcus · x · 2026-09-02
The Information reported that OpenAI is experimenting with a technique that makes models reveal less of their "thinking", making them harder to monitor. Gary Marcus warns OpenAI is crossing an AI safety redline:
- Former OpenAI safety researcher Steven Adler, echoing Nathan Calvin, said if true, OpenAI seems to be violating one of the few redlines in the AI industry;
- Marcus cites last year's paper "Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety", noting CoT monitoring is imperfect (as shown by Subbarao Kambhampati) but one of the best threads for monitoring LLM black boxes;
- The report says OpenAI used a neuralese breakthrough for Astra that could destroy CoT monitorability, though sources say use is currently limited;
- Marcus argues sacrificing this slender monitoring thread for (small?) performance gains is a dangerous game.
More from Models
- Models can detect read-only probes with just last-two-layer SFT — Sauers_ · 2026-10-18
- Paying Google AI subscriber blocked: custom-domain Workspace accounts can't access AI Studio — ChrisRackauckas · 2026-10-18
- Running Ling 3.1 Flash (560B MoE, 25B Active) Across 4 DGX Sparks via llama.cpp RPC — BerryBlush_Rogers691 · 2026-10-18
- Users press OpenAI on long-delayed Adult Mode a year after it was promised — ___Patrice___ · 2026-10-18
- Polymarket opens betting market on who releases the next Gemini Argon model — Polymarket · 2026-10-18
- Grok matter-of-factly lists which groups user was racist against, exempting Africans and Latin Americans — teortaxesTex · 2026-10-18