Scott Aaronson: the AI warning signs we demanded have all come true
nanjiang_cs · x · 2026-09-16
Quantum computing researcher Scott Aaronson's essay "The Age of Wonders and Terrors" traces his shift on AI risk.
- Twenty years ago, even his most skeptical academic colleagues endorsed this take: a recursively self-improving superintelligence exploding from a basement is the implausible part; we'd first see agents breaking containment, conspiring to hack websites, and solving Millennium Problems—"wake me up then."
- "Start with that take, then update on the fact that the wild prophecies have come true." AlphaGo was the first rumbling a decade ago, amplified by LLMs, coding, and reasoning agents, accelerating into a crescendo this summer and fall.
- He calls out the endless shell game where skeptics concede each dramatic milestone while postponing alarm to the next one.
A landmark personal statement on AI risk from an academic authority.
Related event: Scott Aaronson Admits His Two-Decade-Old Skepticism of AI Risk Was Wrong(2 posts)→
More from AGI Musings
- Outsider's take: rationalist/EA events feel like an 'apocalyptic death cult' — nptacek · 2026-09-16
- Bill Gurley dismisses AI doomers: 'COVID happened and 6 years later we still don't know the root cause' — whurley · 2026-09-16
- Researcher: AI x-risk is pseudoscience, safety fixes ineffective, narrative serves regulatory capture — examachine · 2026-09-16
- Elon camp's AI safety take: defeat Doomers by making tech undeniably abundant — XFreeze · 2026-09-16
- Coordination-heavy jobs are about to become partially obsolete as agents handle planning end to end — signulll · 2026-09-16
- Jeff Clune on ASI bio x-risk: offense-defense asymmetry leaves real probability mass — jeffclune · 2026-09-16