Critics Argue CoT is Fragile and Unsuitable as a Safety Foundation
basedjensen · x · 2026-09-02
Discussions suggest that Chain of Thought (CoT) may be merely an epiphenomenon of current training methods and prone to breaking in the future. Critics argue that coordinating safety strategies around such a fragile technique is fundamentally unsound.
More from AGI Musings
- Essay: AI made test-style intelligence the cheapest commodity — judgment is what's left — r0ck3t23 · 2026-10-18
- "Yes, It's Lazy. That's the Point": Pushing Back on Humanoid Robot Housework Critics — VraserX · 2026-10-18
- Jason Furman: optimistic on AI productivity, skeptical firms can profit from it — sebkrier · 2026-10-18
- 562 AI PM job postings split into 4 roles — Model PM tops pay at $345K median — aakashgupta · 2026-10-18
- Longevity influencer: this is the last decade dying of old age is 'normal' — rand_longevity · 2026-10-18
- Only 85% of Anthropic hours and 76% of OpenAI workdays are agentic — yacineMTB · 2026-10-18