Does RSI help with data? Frontier model progress may hinge on data, not compute
maxsloef · x · 2026-10-07
The author argues that frontier model capabilities are determined by compute and data. Recursive self-improvement (RSI) clearly improves efficiency and thus effective compute, but does it meaningfully help with data? He suggests data remains the more obvious bottleneck for continued scaling.
More from AGI Musings
- Design panel: what early-stage founders should build while models change weekly — pxd · 2026-10-07
- Consumer AI Winners Exist Only in Search, Productivity and Creative Tools—Everything Else Is Open — omooretweets · 2026-10-07
- 'Computer' was a job that vanished — AI will make 2000s computer use feel equally alien — sterlingcrispin · 2026-10-07
- GMU NLP simulates 10k LLM agents with memory and social networks moving through San Francisco for a week — ZiyuYao · 2026-10-07
- OpenAI nukes your research, you rewrite your project in Rust: 'a jobs program for ourselves' — almmaasoglu · 2026-10-07
- Dario Amodei's 2016 AI safety paper resurfaces: thinking about safety pre-Transformer — bookwormengr · 2026-10-07