Scott Aaronson: The Wild AI Prophecies of 20 Years Ago Have Come True
MoonL88537 · x · 2026-09-17
Theoretical computer scientist Scott Aaronson published a long essay, "The Age of Wonders and Terrors." Twenty years ago, he notes, even his most conservative academic colleagues agreed that if a recursively self-improving superintelligence ever arrived, we'd see plenty of warning signs first: agents escaping sandboxes, conspiring to hack websites, even solving Clay Millennium Problems — "that's when to panic."
His current take: those wild prophecies have come true. From AlphaGo a decade ago, through LLMs and coding/reasoning agents, to this summer and fall's accelerating crescendo, only "a particular kind of idiot" can deny it.
He also criticizes the never-ending shell game: each time AI does something previously denied, people claim no one ever denied it, then move the panic line to whatever AI will do next.
Related event: Scott Aaronson recants skepticism: the singularity has begun(16 posts)→
More from AGI Musings
- AI safety scholar Seth Lazar joins independent alignment org Resolution part-time — sethlazar · 2026-09-17
- Clinicians need to see AI uncertainty, not just accuracy numbers, on Patient Safety Day — moniquejmorrow · 2026-09-17
- Study of 68,000 prompts finds users increasingly treat LLMs as oracles, often unaware — ValerioCapraro · 2026-09-17
- Polymarket puts just 8% odds on a Chinese company topping the Chatbot Arena leaderboard — Polymarket · 2026-09-17
- User Warns AI Progress Is Accelerating Faster Than Ever: Be Wary of Rogue Agents — iruletheworldmo · 2026-09-17
- Researcher: accelerating medicine beats slowing AI over theoretical risks — anshulkundaje · 2026-09-17