SPSD distills MuZero self-play search into LLM reasoning traces, math jumps 24.1→36.6
PMinervini · x · 2026-09-29
Researchers propose Self-Play Search Distillation (SPSD), asking whether self-play on board games can teach an LLM to reason:
- Method: train MuZero experts via self-play on board games, then distill their search into reasoning traces for LLMs.
- Results: reasoning transfers to unseen games and generalizes to math, improving scores from 24.1 to 36.6.
- Takeaway: planning ability from search-based RL can serve as a reasoning supervision signal beyond text-only distillation.
Related event: SPSD Paper: Self-Play Search Distillation Boosts LLM Reasoning(3 posts)→
More from Research
- Google Research open-sources PaperOrchestra, a multi-agent framework for writing AI papers — google-research · 2026-11-16
- Kind ICLR Reviewer Raises Score Despite Unresolved Concerns, Citing the Paper's Value — MarkSchmidtUBC · 2026-11-16
- Hand-editing 0.2% of weights plus 100 CPU-minutes turns an English TTS model into an 18MB Sanskrit one — kastnerkyle · 2026-11-16
- Why chirality matters for AI for Science: enantiomers behave differently in biology — madeofAjala · 2026-11-16
- RSS 2027 submissions open with FAQ clarifying two-stage review and negative-result bar — GeorgiaChal · 2026-11-16
- Mobile AI Factory: agents auto-build on-device SLMs with 19x less GPU time — pmttyji · 2026-11-16