Self-play on board games distills superhuman CoT, lifting Qwen3-4B math average from 24.1 to 36.6
PMinervini · x · 2026-09-29
New arXiv paper from the University of Edinburgh's Pasquale Minervini group introduces Self-Play Search Distillation (SPSD): MuZero-like networks self-play on board games, and the search records — preferred moves, alternatives, opponent replies, value estimates — are distilled into superhuman chains-of-thought for training LLM reasoning. On Qwen3-4B-Base, SPSD raises the mean over six math benchmarks from 24.1 to 36.6 and lifts held-out-game win rate from 15% to 45%, transferring to unseen math despite training only on game search data. The authors frame massive self-play over synthetic environments as an unbounded source of superhuman post-training data.
Related event: SPSD Paper: Self-Play Search Distillation Boosts LLM Reasoning(3 posts)→
More from Research
- Why chirality matters for AI for Science: enantiomers behave differently in biology — madeofAjala · 2026-11-16
- RSS 2027 submissions open with FAQ clarifying two-stage review and negative-result bar — GeorgiaChal · 2026-11-16
- Mobile AI Factory: agents auto-build on-device SLMs with 19x less GPU time — pmttyji · 2026-11-16
- Berkeley paper: LLMs answer with stale values even when the update is in context — ombre-ai · 2026-11-16
- LatamGPT releases 178.4M-document open Latin American corpus on Hugging Face — OmarUFlorez · 2026-11-16
- Open-source TotalSegmentator spots a 42mm dilated aorta on a routine chest CT — MaziyarPanahi · 2026-11-16