OpenAI warns CoT monitorability will degrade as models scale, researchers push back

gleech · x · 2026-11-17

OpenAI's alignment team published a study on how pretraining, architecture, RL, and model-generated data affect chain-of-thought (CoT) monitorability, using no-CoT capability and CoT controllability as proxies. Their conclusion: models will become harder to monitor via CoT as systems scale.

Researcher RaunoArike flagged a key caveat: the claim that no-CoT capability is explained by base-model perplexity understates architecture effects—changes like looped transformers improve performance on evals measuring serial multihop computation and planning, precisely the capabilities most relevant to unverbalized scheming risk. Evals unaffected by architecture mostly test knowledge retrieval.

The report, authored by Jeffrey G. Wang, Micah Carroll, Jakub Pachocki and others, notes CoT monitoring is a core pillar of OpenAI's safety cases, with full-trajectory monitoring already used for cyber-critical deployments.

Original post →

More from Safety

Safety channel →