vLLM ships DSpark draft model for Kimi K3.1 Pro with up to 30% higher acceptance length

vllm_project · x · 2026-11-18

vLLM, Inferact and Red Hat AI's Speculators team released the DSpark speculative-decoding draft model for Kimi K3.1 Pro: up to 30% higher acceptance length vs the preview on HumanEval, plus gains of 12-24% on long-context benchmarks. A 2K sliding window in every draft layer keeps draft KV memory bounded even at 1M-token context. Weights and vLLM configs are on Hugging Face.

Original post →

More from Infra

Infra channel →