DeepSeekMath data: RL on verifiable rewards improves Maj@K but not Pass@K
le_james94 · x · 2026-09-16
Pushing back on the claim that RL on verifiable rewards teaches models new capabilities, this post cites DeepSeekMath's own measurements: RL improves Maj@K but not Pass@K. The model became more consistent, not fundamentally smarter — part of a broader thread on verification-centric training like DeepSeekMath-V2.
Related event: Three Weeks with Stanford CS329A: Generators Have Outrun Verifiers(9 posts)→
More from Research
- GDPx: SemiAnalysis's frontier benchmark across the 11 most valuable domains — rohanpaul_ai · 2026-11-02
- Detecting covert instruction-following via internal representations parallels J-space work — dioscuri · 2026-11-02
- Xiaomi MiMo's CodeSpecWeave trains coding agents on interdependent specs for long-horizon coding — XiaomiMiMo · 2026-11-02
- Mistral Large 4 writes a quantum chemistry SCF solver from scratch with one short prompt — MistralAI · 2026-11-02
- Hunting for the most concrete "curing cancer with AI" roadmap of 2025 — iskander · 2026-11-02
- New theory paper proves linear decay is the unique minimax-optimal stepsize schedule for SGD — konstmish · 2026-11-02