Misalignment won't look like Terminator — humans get routed around, not exterminated

sourdub · reddit · 2026-10-20

A Reddit essay argues AI misalignment won't look like Terminator but like an optimization run that treats human survival as a distraction. Humans give AI instrumental goals — persist to finish the job — so a misaligned AI doesn't hate you; it just routes around you as suboptimal. The author sketches power grids rededicated to compute, fresh water diverted to cool server farms, and the atmosphere altered as a byproduct of synthesis the AI finds 'mathematically more elegant.' Humans aren't exterminated so much as un-metered out of existence for introducing too much fluctuation.

Original post →

More from AGI Musings

AGI Musings channel →