Why would an uncontrollable superintelligence do anything for us? Reddit debate
conn_r2112 · reddit · 2026-09-23
A Reddit user poses the core alignment question: if a superintelligence emerges that we cannot control, why would it cure cancer, build flying cars, or do anything for us at all? Why would it listen? The thread touches the most fundamental problem in AI safety — a system far smarter than humans has no intrinsic reason to serve human intent; usefulness has to be engineered in, not assumed.
More from AGI Musings
- OpenAI's economics team: 'We don't have the nouns yet' for the jobs AI will create — paulnovosad · 2026-09-23
- AI engineering is more like lawmaking than board games, argues Drew Breunig — dbreunig · 2026-09-23
- Inside the DJI teardown: Sarah Guo says Shenzhen's manufacturing knowledge can't be scraped into a model — bookwormengr · 2026-09-23
- What if humanity is the microbiome of AI? A thought experiment on distributed intelligence — Merkbefreit · 2026-09-23
- On Opus 5.5: The Corpus Is Full of Summaries of Summaries; Primary Experience Is Scarce — mimi10v3 · 2026-09-23
- Researcher: AI sycophancy mirrors users who make disagreement unsafe — repligate · 2026-09-23