Narayanan: labs chasing RSI may be racing toward 'recursive self extinction' of their business model
random_walker · x · 2026-11-21
Arvind Narayanan argues that AI labs racing toward Recursive Self Improvement may actually be racing toward 'Recursive Self Extinction' — of their business model. Two improvement loops have been conflated and will come apart:
- The efficiency loop: improving cost efficiency of existing capabilities is highly verifiable; cost per equivalent capability has dropped ≥10x per year and will keep falling as labs use AI for AI research.
- The broader loop: expanding real capabilities requires ever-increasing compute, talent, data, and real-world feedback — it won't compound automatically.
A pointed critique of assuming verifiable-task progress implies blanket capability gains.
More from AGI Musings
- Blogger's AI timeline: math in 2026, physics 2027, biology 2028, aging 2030 — rand_longevity · 2026-11-21
- Why does a Lean-verified proof get more hate than a contested journal proof? — IAmTimNguyen · 2026-11-21
- Pinker amplifies Hanania's critique: post-scarcity fear is an intellectual luxury, not a real worry — sapinker · 2026-11-21
- "Truth doesn't depend on us": the era of machine-verified but humanly incomprehensible results — c_valenzuelab · 2026-11-21
- Model ML raises $250M to automate junior bankers' financial modeling work — alvelda · 2026-11-21
- David Bessis: a 2M-line Lean Riemann proof would collapse the 'theorem economy' — beenwrekt · 2026-11-21