Compute and Data are the True R&D Bottlenecks
willccbb · x · 2026-07-16
This discussion questions the vagueness of a "1000x R&D speedup," noting that improvements in architecture, optimizers, infrastructure, kernels, chips, and algorithms all have their own ceilings.
The author argues that the variables seemingly without upper limits are compute and data, yet they are the most heavily constrained by physical reality. Replies also suggest that the lifespan of architectures like DSV3 should prompt a reality check for those basing world models on the infinite acceleration of "recursive self-improvement of algorithms."
Related event: Researchers cool expectations around 1000x AI R&D speedups(8 posts)→
More from AGI Musings
- AI researcher on SkyNews flags concerns over inequality, power and criminal misuse — schwarzjn_ · 2026-09-11
- Researcher's SkyNews interview: deeply concerned about AI-driven inequality and power — schwarzjn_ · 2026-09-11
- VC compares AI doom rhetoric to pandemic-era fear messaging — StewartalsopIII · 2026-09-11
- Anthropic Insiders: Not Everyone at the Lab Believes in High p(doom) — anpaure · 2026-09-11
- Could 10k agents discover learning methods beyond backprop, or just tweak existing ones? — SeunghyunSEO7 · 2026-09-11
- AI companionship dissolves the friction real intimacy needs, warns long-form thread — YogeshMalik · 2026-09-11