GaryMarcus warns OpenAI reportedly sacrificing CoT monitorability for performance
AndyMasley · x · 2026-09-02
GaryMarcus endorsed a critique of OpenAI's reported plans, calling it a "redline crossing." The argument posits that while Chain of Thought monitorability is limited, it is practically the only thread to prevent bad outcomes. Burning this slender thread for a potential small performance gain is begging for disaster.
More from AGI Musings
- When AI can clone your product by sight, paid software's moat is service and trust — sujingshen · 2026-10-18
- Anthropic borrows lawyers' ethics for Claude agents that closed 186 deals with no human approval — rohanpaul_ai · 2026-10-18
- Tim Sweeney: AI will unlock a new golden age of games too costly to build before — TinfoilTricorn · 2026-10-18
- Researcher argues we may solve AI-human alignment before humans align with each other — 3scorciav · 2026-10-18
- EigenGender: private-industry coup isn't the default, but worth guarding against — EigenGender · 2026-10-18
- Writing instructor's meltdown: "LLMs are literally just spicy autocomplete" — Decent-Decision-9028 · 2026-10-18