Scott Aaronson: the AI skeptics' twenty-year-old defensible position has collapsed
avt_im · x · 2026-09-16
- Quantum computing researcher Scott Aaronson publishes "The Age of Wonders and Terrors," retracting his long-held AI skepticism.
- Twenty years ago the defensible take was: recursive self-improvement taking over the world without warning is sci-fi; we'd first see agents escaping containment, conspiring, and solving Millennium Problems — "wake me up then."
- His update: those prophecies came true — AlphaGo a decade ago, then LLMs, coding and reasoning agents, accelerating into a summer/fall "crescendo of wonders and terrors."
- He recoils from the moving-goalposts shell game where each AI milestone is instantly reframed as "no one ever denied that." The post includes the line that, by any honest accounting, Yudkowsky was right about civilization's greatest challenge.
Related event: Scott Aaronson Admits His Two-Decade-Old Skepticism of AI Risk Was Wrong(2 posts)→
More from AGI Musings
- Nate Silver: We're not ready for superpersistent AI — StefanoGogioso · 2026-09-16
- Multiplayer AI called the biggest design problem of 2027, with interfaces far from settled — manosaie · 2026-09-16
- Sam Altman: models got smart faster than anyone expected, power concentration is a real fear — kimmonismus · 2026-09-16
- Why isn't anyone vibe coding 'good enough' clones of every habit-protected high-margin app? — citrini · 2026-09-16
- Robotics researcher: Embodied AI progress must push performance, not just cost — GlenBerseth · 2026-09-16
- Debate: Has LLM novelty in science disproven the 'no recursive self-improvement' argument? — ctjlewis · 2026-09-16