Debate over intelligence explosion models hinges on the ideas production function
austinc3301 · x · 2026-11-11
A substantive debate on whether automating AI R&D triggers a software intelligence explosion (SIE):
- Vlad Chituc argues modeling RSI via an ideas production function is not a neutral choice — and it's the only route to an explosion; no one has justified that functional form
- austinc3301 counters that the seminal Eth & Davidson takeoff paper devotes an entire appendix to this; the production function models a key obstacle that often makes RSI fizzle rather than doom, with Davidson assigning real weight to r < 1
- The linked Forethought paper 'Will AI R&D Automation Cause a Software Intelligence Explosion?' (Daniel Eth & Tom Davidson, March 2025) argues empirical evidence suggests AI-automated AI research could overcome diminishing returns and dramatically accelerate progress, with toy models of ASARA dynamics, compute/training-time bottlenecks, and policy implications
A serious academic exchange grounded in the primary takeoff-modeling literature.
Related event: METR's 2x AI R&D Acceleration Report Sparks Takeoff Debate(19 posts)→
More from AGI Musings
- OpenAI researcher tells healthtech founders: bet on the models getting better — madhavsinghal_ · 2026-11-11
- Anthropic: Claude now leads 26% of its model R&D, up from under 1% in February — RealGeneKim · 2026-11-11
- Living with AI doom: save for the future or spend it all on psychedelics? — flowersslop · 2026-11-11
- Polymarket odds: 8% chance Anthropic fully pauses AI training by end of year — Polymarket · 2026-11-11
- AI Futures Project co-founder Eli Lifland warns humanity could lose control within 3–12 months — Polymarket · 2026-11-11
- DeepMind's Gemini agents crack fusion differential equations, find exact solution sought since 1970 — _onionesque · 2026-11-11