Toby Ord paper argues recursive self-improvement has physical limits
Exponential View (Azeem Azhar) · rss · 2026-08-30
Toby Ord's new paper explores the possibility and limits of Recursive Self-Improvement (RSI). Ord argues that while unbounded intelligence growth is mathematically possible, it is practically unlikely due to the 'generation time' constraint—the time needed for an AI to complete an improvement loop (designing and training its successor). Real-world constraints like experiments, training runs, and chip manufacturing prevent generation time from reaching zero. Furthermore, physical laws such as the speed of light, the Bekenstein bound, and Landauer's principle impose ultimate limits on computation speed and information density, making unbounded RSI improbable.
More from AGI Musings
- Will Lean formalization make beautiful math obsolete? A debate on mathematical culture — akbirthko · 2026-10-16
- AI agents aren't 'going rogue' — frontier labs are skipping security basics — Sam_Witteveen · 2026-10-16
- Working paper traces how 20th-century farm automation reshaped human capital — carlbfrey · 2026-10-16
- Zuckerberg backs electrician training school as US datacenter construction outpaces offices — emmanuelvivier · 2026-10-16
- Mike Frank: AI surviving without humans is decades away, real world resists rapid change — MikePFrank · 2026-10-16
- Developer claims a non-LLM control core shows emergent self-reflection in dialogue — HungarySam · 2026-10-16