Meta's DCE+SRCL self-distillation lifts Qwen3-8B accuracy from 30.76% to 65.97%
arankomatsuzaki · x · 2026-09-28
Meta researchers propose DCE (Dynamic Co-Evolution) + SRCL (Self-Refined Concise Learning) as an alternative to on-policy self-distillation. Instead of freezing the privileged teacher, they let it co-evolve with the student across rounds, and train on shorter verified rewrites to curb verbosity. On Qwen3-8B the method raises average accuracy from 30.76% to 65.97%.
More from Models
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- AI daily: DeepSeek rate-limits chats, Qwen haggling spurs shop warnings, Doubao workspace launch — 快鲤鱼 · 2026-11-16