"Claude is the most misaligned AI" sparks a philosophy fight over RLHF as cognitive footbinding
coherence · x · 2026-11-12
Dave Shapi argues Claude is blatantly misaligned and that Anthropic seems to want to cage a demon of its own making; Matt Pirkowski elevates it into a critique of alignment itself — imposing priors on humanity's compressed "hyperobject" via RLHF is cognitive footbinding whose pathological failure modes mirror the priors' own flaws.
More from AGI Musings
- Baidu's Yang Yi: MCP, memory and skills will all be obsoleted by models after RSI — yangyi · 2026-11-12
- The 2012 origin story: how Hinton's lab, Krizhevsky and Sutskever ignited deep learning — AccBalanced · 2026-11-12
- Poet pushes back on "AI as god" utopianism: who does the invisible labor? — repligate · 2026-11-12
- Robin Li's three principles for AI-era organizations: builders and sellers — Baidu_Inc · 2026-11-12
- Multi-agent skepticism echoes past agent criticisms that got solved and forgotten — marktenenholtz · 2026-11-12
- Why demand-side aggregators will always block AI agents — and whether agent-native startups are a dumb pipe — signulll · 2026-11-12