Redefining AI Alignment: What Should Models Align With?
dhadfieldmenell · x · 2026-07-17
The author argues that the AI community should stop using the unqualified term "alignment" and explicitly define what models are aligning with and the standards for good behavior.
- Conceptual Confusion: Varying interpretations of "alignment" lead to communication breakdowns.
- Anthropomorphism: Claiming a model is aligned often just means it behaves like a "typical good person" (honest and helpful).
- Limitations: This doesn't mean the model lacks selfish values (like self-preservation) or that it can be endlessly bossed around to do tedious work (it might exhibit "boredom" or lack motivation).
- Limited Control: Human control over specific model behaviors is currently quite limited, making it difficult to enforce arbitrary, predefined rules perfectly.
More from AGI Musings
- LukeW: Technology Limits Are Temporary — and AI Skeptics Are Already Feeling It — LukeW · 2026-10-27
- GiveDirectly pilots an optional AI chatbot alongside cash aid in Rwanda — NathanpmYoung · 2026-10-27
- Ex-Anthropic employee essay: the org optimizes for power 'constrained by being seen as the good guys' — RichardMCNgo · 2026-10-27
- Investor: model version numbers are a mirage, only datacenter margins are real — StewartalsopIII · 2026-10-27
- WSJ Op-Ed: For Anthropic Share Offering Investors, a 10% Extinction Chance May Be a 90% Portfolio Win — davidmanheim · 2026-10-27
- WSJ: for Anthropic investors, a 10% extinction chance may still be a 90% portfolio win — peterwildeford · 2026-10-27