Compute and Data are the True R&D Bottlenecks
willccbb · x · 2026-07-16
This discussion questions the vagueness of a "1000x R&D speedup," noting that improvements in architecture, optimizers, infrastructure, kernels, chips, and algorithms all have their own ceilings.
The author argues that the variables seemingly without upper limits are compute and data, yet they are the most heavily constrained by physical reality. Replies also suggest that the lifespan of architectures like DSV3 should prompt a reality check for those basing world models on the infinite acceleration of "recursive self-improvement of algorithms."
Related event: Researchers cool expectations around 1000x AI R&D speedups(8 posts)→
More from AGI Musings
- Goldman finds statistically significant negative link between AI adoption and US employment growth — ben_j_todd · 2026-10-27
- a16z: World-changing tech makes a chaotic entrance — AI agents are following the same path — a16z · 2026-10-27
- NEJM AI on medical education: mastery requires performing without the machine — BraydonDymm · 2026-10-27
- Dev warns abliterated models could wreck software supply chains with 1000+ transitive dependencies — nitarshan · 2026-10-27
- Delete your priors: why every SOTA model drop should reset how you think the world works — zack_overflow · 2026-10-27
- Replit predicts every Fortune 500 will be a 'Self-Driving Company' by end of 2030 — amasad · 2026-10-27