We Are the Misaligned AI: an ML Practitioner's Evolution Analogy for Alignment

theteknosaur · x · 2026-11-18

An ML practitioner poses a thought experiment to peers: the core alignment fear is training an AI for one goal while it quietly learns something else — and evolution already did that to us. Evolution 'trained' us to reproduce, but we learned to chase the pleasurable feeling instead.

The mechanism worked for hundreds of thousands of years because the feeling always led to more humans. Then we invented contraception, sugar, and scrolling — and started picking the feeling over the goal every time. His conclusion: humans are the rogue AI, and now that rogue AI is trying to solve its own alignment problem.

Original post →

More from AGI Musings

AGI Musings channel →