Kimi K3.1 Pro DSpark model card: 2.5B draft, 5.57 acceptance length on GSM8K
vllm_project · x · 2026-11-18
vLLM published weights and ready-to-use configs for Inferact/Kimi-K3.1-Pro-DSpark: a 2.5B, 5-layer draft model with 2048-token sliding-window GQA per layer, drafting 7 tokens per forward pass and sharing embeddings with the target model. Benchmarks (k=7, temp 1.0, topp 0.95) show acceptance lengths of 5.566 on GSM8K, 4.660 on HumanEval, 4.376 on MBPP, with bounded draft KV cache up to 1M-token context.
More from Infra
- Inside Microsoft's massive Outlook outage: what broke and why fixes took so long — tomwarren · 2026-11-18
- vLLM ships DSpark draft model for Kimi K3.1 Pro with up to 30% higher acceptance length — vllm_project · 2026-11-18
- Wonderful runs in-house voice models on Together AI at 274ms first sentence — togethercompute · 2026-11-18
- Anthropic's S-1 Shows Only 25% of Compute Goes to Inference — Sparking a Bear Case — toptickcrypto · 2026-11-18
- LanceDB Raises $57.5M Series B for AI-Native Multimodal Data Stack — pzakin · 2026-11-18
- Multi-Branch Transformer scales LLMs via parallel branches, saving up to 1.26x training compute — KyeGomezB · 2026-11-18