Steven Pinker Lists Four Objections to AI Extinction Scenarios, Sparking Point-by-Point Rebuttal
burny_tech · x · 2026-09-27
In his letter to Scott Alexander, Steven Pinker laid out four objections to AI extinction scenarios, and Jim Miller responds to each.
- Objection 1: Pinker argues the scenarios rest on an underdeveloped conception of intelligence—treating it as a quantity of power extrapolated from animals to dull humans to smart humans to AI to omniscient superintelligence. He holds that any intelligent system is a mechanism good at solving some problems but not others, inherently limited by knowledge attainable only through observation and experimentation.
- Miller's reply: nobody disputes the need for knowledge; AI systems already absorb vast amounts from books, and are now being connected to biological laboratories to learn through experiments.
A substantive exchange in the ongoing AI-risk debate among Pinker, Scott Alexander, and Scott Aaronson; the remaining points and rebuttals continue in the original thread.
More from AGI Musings
- Malthus Saw It in 1798: Wealthy Avoiding Kids, Delayed Marriage Repeats Today — SydSteyerhart · 2026-11-16
- Runway CEO Predicts Fully AI-Generated Cultural Phenomenon by 2027 — c_valenzuelab · 2026-11-16
- '5% worse and 10% cheaper': the button with no vote is already everywhere — eigenrobot · 2026-11-16
- Effective Altruism is top-down and hierarchical, not a grassroots movement — ctjlewis · 2026-11-16
- Lawyers say clients' AI use creates unrealistic expectations and fake case law in settlements — hoofnagle · 2026-11-16
- Dev debunks 'rogue AI' hype: subsidized subscriptions can't fund expensive swarms — gerardsans · 2026-11-16