X Debates RSI Doom Narrative and Slowing AI: Chimera or Years Away
From Sept 21-23, X hosted several rounds of debate over whether AI development should slow and whether the "recursive self-improvement (RSI) runaway" narrative is credible. binarybits laid out a middle position in exchanges with davidshor, jonmellon and chrislhayes; gregtravis and basedjensen clashed over whether current AI can achieve RSI at all; practitioner goodside judged RSI to be at most a few years away; and damianbot's spat with Timothy B. Lee over trusting frontier labs pushed the argument to motivated reasoning, with binarybits adding a pointed "Coinbase on crypto" analogy.
Confirmed
- binarybits finds the narrative of being on the edge of runaway RSI unconvincing, while acknowledging today's models could cause plenty of mundane but real damage.
- He can understand cautious slowdown or tighter regulation, but opposes targeting a "ban on RSI" because the concept is, like "AGI," a chimerical notion.
- He considers the argument "AI may destabilize society unpredictably, so slow down" quite reasonable; his objection is to the urgent narrative of labs imminently launching RSI toward superintelligence and losing control.
- binarybits argued doomer/non-doomer splits are mostly emphasis, not fundamental policy disagreement: many near-term proposals align, and doomers also back "normal" oversight mechanisms.
- jonmellon likewise questioned the RSI-emergency framing, locating the danger in accelerated deployment of AI rather than runaway superintelligence.
- davidshor strongly opposed slowing AI, arguing the world is already fragile.
- gregtravis reiterated that RSI is not happening and cannot happen with current AI—it would require thinking machines, whereas AI is just a linear-algebra equation solver. basedjensen reposted to rebut that RSI is happening or imminent.
- goodside (Riley Goodside) said he is highly uncertain about AI's economic impact, but believes RSI is at most a few years away and will not stop at human-level intelligence.
- On Sept 22, damianbot questioned why anyone would dismiss frontier lab executives' internal judgments on RSI—people steeped in the topic for a decade—calling it a big claim to say figures like EvanHub are wrong; the backdrop is Ezra Klein's relatively late attention to the issue.
- Against Timothy B. Lee's skepticism, damianbot countered that the risk judgments come from the labs' own published data and policy plans; Lee maintained the labs' "RSI is imminent" stance itself deserves scrutiny.
- binarybits waded in with the analogy: "Why ignore Coinbase leadership's well-grounded judgment on crypto's transformative potential?"—implying frontier-lab executives, despite insider information, are subject to strong motivated reasoning.
- On Sept 23, a view reposted by burnytech added a methodological critique: AI self-improvement talk conflates incremental improvement with genuinely recursive improvement—where each step's rate of improvement itself grows exponentially—and no one has actually measured that metric, so the discussion is all vibes.
Unconfirmed
- Whether and when RSI can occur remains sharply contested: gregtravis says impossible, binarybits calls it a chimera, goodside says a few years away—none adjudicated by evidence, and per burnytech's reposted critique, there is no agreed measurable definition of RSI.
- How much labs' internal RSI judgments reflect technical reality versus motivated reasoning remains an unresolved dispute with no decisive evidence.
Why it matters
- The debate is a textbook sample of the "doomer vs. realistic risks" divide in AGI-risk discourse: sides may agree on near-term policy while diverging sharply on RSI and superintelligence narratives.
- It bears directly on whether "banning RSI" is a viable regulatory goal—if the concept is deemed chimerical and unmeasurable, legislation built on it loses its footing.
- The damianbot/binarybits exchange shifts the question from "is the narrative credible" to "whose epistemic authority is credible": labs' first-hand data and decade of immersion, or outside critics' suspicion of their incentives—shaping how the public prices labs' own risk warnings.
- Disagreement among practitioners themselves (gregtravis vs. basedjensen, goodside) shows RSI is not a consensus technical premise within the industry.
2026-09-21 ~ 2026-09-23 · 14 related posts
- Episode 1: Timothy B. Lee Questions AGI and Recursive Self-Improvement as Discontinuous Events(2026-09-17, 8 posts)
- Episode 2: Turing Post Guide: Most AI-Improving-AI Isn't True Recursive Self-Improvement(2026-09-18, 2 posts)
- Episode 3: Ezra Klein Calls for a Ban on Recursive AI Self-Improvement(2026-09-20, 10 posts)
- Episode 4: X Debates RSI Doom Narrative and Slowing AI: Chimera or Years Away(2026-09-21, 14 posts)
- Episode 5: Ezra Klein Now Fully Embraces AI X-Risk Narrative(2026-09-22, 2 posts)
- Episode 6: Ezra Klein's Call to Ban AI-Written Code Draws Backlash(2026-09-22, 5 posts)
- Episode 7: Researchers Debate Whether Massively Parallel Agents Amount to RSI(2026-09-23, 2 posts)
Primary sources
- 'An AI hallucination nearly sparked an attack on a Chinese ship': X users debate slowing AI — binarybits · 2026-09-21
- Blogger rebuts the 'RSI-to-superintelligence emergency' framing of AI risk — binarybits · 2026-09-21
- Jon Mellon challenges RSI emergency framing: the risk is speed, not loss of control — jon_mellon · 2026-09-21
- binarybits: doomers and skeptics may differ in emphasis, not policy agenda — binarybits · 2026-09-21
- [source] binarybits: runaway 'RSI' narrative doesn't hold, but today's models can still do real damage — binarybits · 2026-09-21
- Recursive self-improvement is a chimerical concept, argues binarybits — binarybits · 2026-09-21
- AI debate: binarybits calls RSI loss-of-control implausible but sees real damage risk — _damian_bot · 2026-09-21
- Is Recursive Self-Improvement Real? AI Circle Clashes Over Whether LLMs Can Bootstrap — basedjensen · 2026-09-21
- Debate: should we trust frontier lab leaders on RSI, or beware motivated reasoning? — _damian_bot · 2026-09-22
- goodside: recursive self-improvement is at most years away and won't stop near human level — cephaloform · 2026-09-22
- Debate flares over whether 'recursive self-improvement' is real for AI — eigenrobot · 2026-09-22
- Nobody measures recursive self-improvement, so it's all vibes — burny_tech · 2026-09-23
2 near-duplicate retellings: binarybits · ctjlewis