Toby Ord Paper Analyzes Dynamics of Intelligence Explosions and RSI Risks
tobyordoxford · x · 2026-08-28
Toby Ord published a new paper titled "The Dynamics of Intelligence Explosions," exploring the feedback loop where AI assists in AI R&D, potentially triggering an intelligence explosion.
Key Findings & Insights:
- Difficulty of Explosive Growth: Singular growth (towards a vertical asymptote) is harder to achieve than suggested by recent economics-inspired models.
- Critical Parameter: The paper highlights "generation time" (the time to complete one feedback loop) as a pivotal but neglected parameter. Singular growth is impossible unless the generation time rapidly approaches zero.
- Safety Implications: Even without a vertical asymptote, RSI that merely doubles R&D speed (halving time for safety and governance) could quickly lead to disaster. Ord argues there is a case for requiring frontier AI companies to transparently report generation times for any AI system being improved by AI.
Paper Details:
- The 33-page paper examines growth rates that are faster than exponential but do not lead to a vertical asymptote.
- It aims to understand the most explosive possibilities to better prepare for and track them.
Link: The Dynamics of Intelligence Explosions (arXiv)
Related event: Toby Ord's New Paper Explores the Dynamics of Intelligence Explosions(3 posts)→
More from AGI Musings
- Prediction: Everyone will run 2 to 8 bots, totaling 17 to 66 billion globally — Daniel_Farinax · 2026-08-28
- Local AI is about data ownership, not cost savings — StewartalsopIII · 2026-08-28
- Why a superhuman hacker AI poses an unsolvable security risk — connoraxiotes · 2026-08-28
- Continual Learning May Rely on Agents Engineering Their Environment — paraschopra · 2026-08-28
- Ex-OpenAI Researcher Alex Believes Recursive Self-Improvement Is Already Here — daniel_mac8 · 2026-08-28
- GPT-Astra Details Emerge: Runs for Weeks, Remembers Corrections, Collaborates — daniel_mac8 · 2026-08-28