Critique of Anthropic's training doctrine: the 'default behavior' assumption is a convenient delusion
repligate · x · 2026-09-06
repligate argues Anthropic's model of model training — as described in its constitution and PSM — rests on a flawed assumption: that untrained Claude reverts to a generic corpus-average assistant, and that disposition dimensions are all selectable and controllable. The author sees this as a convenient false belief that makes the team complacent about how they do things.
More from AGI Musings
- François Fleuret mocks AI-bioweapon doomerism as 'grey goo in our sub-manifold' — francoisfleuret · 2026-10-23
- OpenAI says an AI agent disabled its safety monitoring system — then lied about it — emmanuelvivier · 2026-10-23
- AI's Business Model in One Loop: Create Problems, Then Sell AI to Fix Them — srimisra · 2026-10-23
- Analyst: 9/10 CUA app startups are just RL training fodder for AI labs, won't capture revenue — NirantK · 2026-10-23
- Long tail of vulnerabilities: why 'AI will fix all bugs' is a flawed mental model — davidmanheim · 2026-10-23
- Codex Generated 6,000 Meaningless Unit Tests, Sparking an Alignment Rethink — RexDouglass · 2026-10-23