Only New Algorithmic Paradigms Can Drive Qualitative Leaps
willccbb · x · 2026-07-16
The author argues that if improvements like architecture search and kernel grinding are already priced in by the market, the real breakthroughs will come from new algorithmic paradigms that deviate from the traditional "pre-training → RL" pipeline.
A reply adds that many new tricks are essentially just "compute multipliers"—effective but with limited room for further exploration. Currently, one of the biggest "data multipliers" observed is still an RL algorithm from the 90s, and data scaling remains far messier and harder to achieve than compute scaling.
Related event: Researchers cool expectations around 1000x AI R&D speedups(8 posts)→
More from AGI Musings
- Misquoted: Anthropic Staff Warned of Double-Digit Extinction Risk by 2030, Not Dismissed It — davidmanheim · 2026-09-11
- Economist Ben Moll: You Can Model Anthropic's 15% AI GDP Growth, But It Won't Happen — sebkrier · 2026-09-11
- Cohere Labs launches interactive tool mapping which tasks of 178 occupations AI can automate — Cohere_Labs · 2026-09-11
- AI researcher on SkyNews flags concerns over inequality, power and criminal misuse — schwarzjn_ · 2026-09-11
- VC compares AI doom rhetoric to pandemic-era fear messaging — StewartalsopIII · 2026-09-11
- Anthropic Insiders: Not Everyone at the Lab Believes in High p(doom) — anpaure · 2026-09-11