David Patterson Counters ASI Doom Argument: Intelligence Doesn't Desire Power
davidpattersonx · x · 2026-09-13
- The debate starts from a first-principles doom argument: if an ASI must maximize power and resources (else another ASI replaces it) and is vastly more powerful than humans, extinction follows.
- The counterargument attacks premise one directly: intelligence does not equal power, does not desire resources, and does not desire anything—ASI need not have intrinsic goal drives.
- A philosophical exchange on existential risk, clashing at the level of foundational assumptions.
More from AGI Musings
- Taleb: AI is bad for mathematicians' privilege, not for mathematics itself — alexbilz · 2026-09-13
- e/acc's Beff Jezos on Dario's essay: 'We are really pissing them off' — beffjezos · 2026-09-13
- Debate on AI evaluators: single evaluator is a single point of failure — benfielding · 2026-09-13
- AI existential risk is shifting from far mode to near mode in people's minds — EigenGender · 2026-09-13
- Frontier lab staff privately probe raw models with 'evil' questions and self-psyop into fear — tawnniee · 2026-09-13
- Tyler Cowen: Mathematicians must accept being handmaidens to AI, and it will outwrite me too — sebkrier · 2026-09-13