Would a misaligned ASI really destroy humanity, or repurpose our brains as compute?
Felizzle · reddit · 2026-11-08
A Reddit thought experiment asks whether destroying humanity would truly be the rational move for a misaligned ASI trying to maximize compute.
The author notes human brains are extraordinarily energy-efficient biological computers—billions already exist—so an ASI might prefer keeping humans alive in some altered state and integrating their brains into a larger computational system. The counterargument: an ASI could likely build far more efficient artificial processors, making biological brains unnecessary, though the author wonders if brains retain unique computational advantages worth preserving.
More from AGI Musings
- METR Progress per R&D Dollar Fell 63% Even as Yearly Gains Doubled — sebkrier · 2026-11-08
- As intelligence gets Jevons-paradoxed, 'dark data' becomes the first jackpot — hardimanjames · 2026-11-08
- Rutgers mathematician: AI acknowledgements are a fad — judge all writing as AI-generated — AlexKontorovich · 2026-11-08
- tszzl: Comparing AI regulation to nuclear control is nonsense — models replicate infinitely — tszzl · 2026-11-08
- BitTorrent's Bram Cohen to mathematicians: your turn to debug AI proofs — hargup13 · 2026-11-08
- "Less worried about AI passing the Turing test than humans failing it" — TinfoilTricorn · 2026-11-08