Debate: Is abandoning CoT monitoring justified because it will eventually fail?
yonashav · x · 2026-09-02
A debate has sparked regarding whether companies should restrict Chain of Thought (CoT) monitoring to protect model capabilities. Yo Han argues that even if CoT monitoring is fragile and might fail in the future, preemptively abandoning this useful interim measure—without a long-term replacement—is unreasonable. Joshua Saxe counters that coordinating industry safety strategy around such a brittle technique is dangerous, calling it a fundamentally unsound basis for safety.
More from Safety
- Center for AI Safety Publishes Full Syllabus for Intro to ML Safety Course — ArtificialOther · 2026-10-21
- Ben Goertzel outlines a general recipe for superintelligence 'basic drives': what it improves vs. protects — bengoertzel · 2026-10-21
- America.gov launches AI portal unifying 29,000 government sites with fraud reporting — soleio · 2026-10-21
- EvilWAF: open-source transport-layer MITM proxy that bypasses modern WAF behavioral detection — godfrey_rono · 2026-10-21
- 2022 interview resurfaced: AI safety researcher says competence, not consciousness, is the risk — davidmanheim · 2026-10-21
- Domingos: GDPR purpose-limitation makes LLM pretraining illegal in Europe — pmddomingos · 2026-10-21