OpenAI Staff Debunk 'Neuralese' Rumors, Emphasize Chain-of-Thought Monitoring
cephaloform · x · 2026-09-02
OpenAI researcher Micah Carroll responded to misconceptions about OpenAI using 'neuralese' models, warning that such confusion could trigger a 'race to the bottom in monitorability.' Colleague Merettm clarified that the computational graph depth of current frontier models, including Astra, is within a factor of two of GPT-4. He emphasized that OpenAI has worked to preserve and utilize chain-of-thought (CoT) monitoring since their first reasoning models to observe alignment generalization. Despite the technique being fragile and trending negatively, strengthening it remains a core research goal.
More from Safety
- David Sacks: Anthropic blocking 90-99% of distillation proves regulation was never needed — AlexTensor · 2026-10-18
- Friends don't let friends feed their data to AI agents: Verge on Muse AI consent — IndependentCoast3974 · 2026-10-18
- Redditor proposes AI regulation framework: text detection, face verification, open algorithms — techtotechbytechy · 2026-10-18
- Prompt injection via email can hijack your AI agent — jev-guard adds risk-scored guards — sujingshen · 2026-10-18
- Users press OpenAI on long-delayed Adult Mode a year after it was promised — ___Patrice___ · 2026-10-18
- Viral AI safety report debunked: 'stolen keys' were just a 'test' string — basedjensen · 2026-10-18