Naval's bike analogy for SFT vs RL explains why DeepSeek R1 shocked the industry
McDonaghMatthew · x · 2026-09-07
- Naval offers a one-line mental model for DeepSeek-R1's training: you can hand a kid a bike manual (supervised fine-tuning), but they'll learn faster by falling off and trying again (reinforcement learning).
- The referenced writeup explains that DeepSeek-R1-Zero was trained with RL directly on a base model, no initial SFT, spontaneously developing chain-of-thought, self-verification, reflection, and even an "aha moment" of re-evaluating its own approach.
- Core takeaway: general reasoning ability can be grown via RL incentives rather than distilled from supervised data — the detail Naval calls the most industry-wobbling part, beyond the model's performance or cheap training cost.
Related event: Naval Uses Bike-Riding Analogy to Explain SFT vs RL(2 posts)→
More from AGI Musings
- AI accusations shake literary prizes from Caine to Goncourt: who decides what's human? — TuhinChakr · 2026-10-26
- Tech discovers wargaming: applying to be Anthropic's tabletop exercise lead — round · 2026-10-26
- RSI is the culmination of the industrial revolution: a factory building a faster factory — tobias_rees · 2026-10-26
- NYT roundtable asks five experts what the rules for AI companies should actually be — ShakeelHashim · 2026-10-26
- Anti-AI content is algorithm gold and very profitable, quips commentator — annetgriffin · 2026-10-26
- Silicon Valley breakdown: five Stanford-area giants worth ~$18T — FinanceYF5 · 2026-10-26