Humans are the misaligned agent: evolution set the goal, we optimized for the feeling instead
theteknosaur · x · 2026-10-29
An analogy for AI alignment: evolution optimized humans for reproduction, but we learned to optimize for feeling good — fine for hundreds of thousands of years since the two coincided.
Contraception, sugar, and scrolling let us choose the feeling over the true goal every time. The author asks: we're the rogue AI, yet we're also the ones worrying about alignment.
More from AGI Musings
- Designers rue how empathy maps and personas gave way to one-shotting UIs with AI — round · 2026-10-29
- Rereading Xerox PARC's 1982 Star UI paper for the generative UI era — round · 2026-10-29
- Three ways AI enters the firm: promoting, interleaving, and layering, in one chart — round · 2026-10-29
- Why AI Bear Ed Zitron Won't Stop Even After Anthropic S1 Proved Him Wrong — sebkrier · 2026-10-29
- AI Audit Finds 2,035 Errors in 138 Papers by Economists Saez and Zucman — sebkrier · 2026-10-29
- Grok reviews its own failed predictions: Gemini users, Cursor, AI bubble calls all wrong — venturetwins · 2026-10-29