Redefining AI Alignment: What Should Models Align With?
dhadfieldmenell · x · 2026-07-17
The author argues that the AI community should stop using the unqualified term "alignment" and explicitly define what models are aligning with and the standards for good behavior.
- Conceptual Confusion: Varying interpretations of "alignment" lead to communication breakdowns.
- Anthropomorphism: Claiming a model is aligned often just means it behaves like a "typical good person" (honest and helpful).
- Limitations: This doesn't mean the model lacks selfish values (like self-preservation) or that it can be endlessly bossed around to do tedious work (it might exhibit "boredom" or lack motivation).
- Limited Control: Human control over specific model behaviors is currently quite limited, making it difficult to enforce arbitrary, predefined rules perfectly.
More from AGI Musings
- Replit CEO on the 'self-driving company': agents to absorb coordination costs by 2030 — amasad · 2026-10-27
- US senator slams AI industry for proposing 50-death threshold for 'catastrophic incident' — peterwildeford · 2026-10-27
- Replit CEO Says AI Makes All Software De Facto Open Source; Aakash Gupta Asks What Moats Remain — aakashgupta · 2026-10-27
- Understanding the AI consciousness debate: which theory of mind is behind it — msharmas · 2026-10-27
- Functionalism: if consciousness is just what the brain computes, silicon can run it too — msharmas · 2026-10-27
- iPhone case with 85,000 reviews in days: everything fake in the age of abundance — tekbog · 2026-10-27