Dwarkesh's Bet: Sample Efficiency and Continual Learning Will Step-Change AI Within 1-2 Years
PTrubey · x · 2026-09-30
PTrubey endorses Dwarkesh's read of the next 1-2 years: while OpenAI and Anthropic squeeze maximum efficiency out of the existing backpropagation paradigm, others are tackling core ML problems like sample efficiency and continual learning — breakthroughs that could step-change the entire industry. The point draws on Dwarkesh's recent interview with an OpenAI researcher, highlighting a split between in-paradigm optimization and paradigm-level research.
More from AGI Musings
- The cruel cycle: labs RL a skill, wrapper startups pile in, labs ship the killer — generativist · 2026-09-30
- Top interpretability expert Neel Nanda: don't rely on us to save you on the current trajectory — burny_tech · 2026-09-30
- Brundage: unheeded warnings should be the baseline assumption for all AI incidents — Miles_Brundage · 2026-09-30
- AI researcher Irina Rish: proceed with "caution without fear," not paralysis — irinarish · 2026-09-30
- OpenAI exec: deciphering ancient scripts is what superintelligence excites me most — BorisMPower · 2026-09-30
- We're entering a world of Jevons paradox as AI efficiency gains fuel more usage — realsohamparekh · 2026-09-30