Jon Mellon challenges RSI emergency framing: the risk is speed, not loss of control
jon_mellon · x · 2026-09-21
In a debate with @binarybits, @davidshor and @chrislhayes, Jon Mellon lays out his objection to AI risk narratives:
- What he rejects is the intellectual framework claiming labs are about to trigger RSI (recursive self-improvement) leading to superintelligence, loss of human control, and thus an emergency.
- However, he concedes that even without that framing, RSI remains dangerous in the sense that we may get and entrench technology that is destabilizing in hard-to-predict ways much faster than expected.
A substantive exchange on how doomers and non-doomers frame AI risk differently.
Related event: X Debates RSI Doom Narrative and Slowing AI: Chimera or Years Away(14 posts)→
More from AGI Musings
- Business strategy debate: hide the AI behind humans, not humans behind AI — annetgriffin · 2026-11-12
- If superhuman AI researchers are imminent, will capability problems be easier than safety ones? — ronbodkin · 2026-11-12
- "AI is a terrible teacher": viral pushback against personalized AI tutoring hype — RachelVT42 · 2026-11-12
- OpenAI, Anthropic and DeepMind job posts signal PMs must write evals and code — aakashgupta · 2026-11-12
- Architecture study sparks monitoring concerns over a multi-hop planning spike — ChowdhuryNeil · 2026-11-12
- PowerShell creator Jeffrey Snover at Ignite: AI revolution is an extinction event for those who don't adapt — dfinke · 2026-11-12