Qwen Open-Sources SpecOPD, Speeding Speculative Decoding Up to 3.56x
Alibaba's Qwen team open-sourced SpecOPD, a branch-parallel online distillation framework that improves drafter quality for speculative decoding, delivering up to 3.56x faster inference.
2026-11-05 ~ 2026-11-06 · 2 related posts