Wes Pegden: in 25 years AI could make decisions we no longer comprehend at all
littmath · x · 2026-10-11
Reposting a point from theoretical computer scientist Wesley Pegden: the AI risk framing is misplaced. The problem isn't "AI discovers medicine next year and we don't understand it" — it's that we have decided human understanding no longer matters, so in 25 years the AI will be making decisions about things we have no comprehension of at all. A sharp reframing of the understanding-vs-capability alignment debate.
More from AGI Musings
- Mathematician: genius worship fuels anxiety behind AI-era debates in math — arjunrajlab · 2026-10-11
- AI Circle Debates Peer Review: Is Breaking Academic 'Norms' Good for Science? — basedjensen · 2026-10-11
- Utilitarian Work Is Dead, Games and Storytelling Are the Open Field — itsmnjn · 2026-10-11
- Narrow ASI Inevitable, Broad ASI Not: Ramez and Sayashk Debate Task-Level Limits — sudoraohacker · 2026-10-11
- Lancet Commission lists 17 major 21st-century health threats, with malicious AI use among catastrophic risks — emmanuelvivier · 2026-10-11
- Would you take an AI-developed drug no human understands? Alignment debate reignites — inductionheads · 2026-10-11