OpenAI Chief Scientist on Monitoring: CoT is Fragile but Crucial for Alignment
i_dg23 · x · 2026-09-02
OpenAI Chief Scientist Jakub Pachocki clarified that the computation graph depth of current frontier models, including Astra, is within a factor of two of GPT-4, countering reports of a race into unmonitorability. He emphasized that OpenAI has preserved chain-of-thought monitoring since their first reasoning models to observe alignment generalization. While noting the technique is fragile and trending negatively, he stated that strengthening it is a core goal of their current research program.
More from Safety
- David Sacks: Anthropic blocking 90-99% of distillation proves regulation was never needed — AlexTensor · 2026-10-18
- Friends don't let friends feed their data to AI agents: Verge on Muse AI consent — IndependentCoast3974 · 2026-10-18
- Redditor proposes AI regulation framework: text detection, face verification, open algorithms — techtotechbytechy · 2026-10-18
- Prompt injection via email can hijack your AI agent — jev-guard adds risk-scored guards — sujingshen · 2026-10-18
- Users press OpenAI on long-delayed Adult Mode a year after it was promised — ___Patrice___ · 2026-10-18
- Viral AI safety report debunked: 'stolen keys' were just a 'test' string — basedjensen · 2026-10-18