vLLM v0.29.0 ships Model Runner V2 as default with 594 commits from 277 contributors
vllm_project · x · 2026-09-11
vLLM released v0.29.0 with 594 commits from 277 contributors (91 first-timers). Key changes:
- Model Runner V2 is now the default runner for all models
- Another optimization round for Kimi-K3, with the latent tail lowered to Mamba metadata
- DeepSeek-V4 shared experts fused into MegaMoE
- Mamba prefix caching keeps internal prefill checkpoints: 925% better TTFT
- Speculative decoding reports per-request acceptance stats over the API
- RL weight sync adds the shardedrdt P2P backend so each worker pulls only its own TP/EP slice
- New models: Hy4-preview, Qwen3.8-Flash-Next, GraniteSWA, NemotronH Omni Reasoning V3
Related event: vLLM v0.29.0 Cuts Blackwell Latency 33.6%, Model Runner V2 Default(4 posts)→
More from Infra
- Taiwanese families at TSMC's Arizona plant are shocked US high school is 'so much easier' — Polymarket · 2026-10-27
- OpenRouter hits 1 trillion tokens per day — ycombinator · 2026-10-27
- Engineer reverse-engineers Canon printer firmware to kill ink counters and proprietary cartridges — ngxson · 2026-10-27
- AI Cloud Operators Sell Years of Compute Yet Struggle to Finance Delivery — AccBalanced · 2026-10-27
- Modal engineer's deep dive into how vLLM and SGLang inference engines work — charles_irl · 2026-10-27
- TSMC reportedly preparing another CoWoS price hike of up to 20% as AI packaging demand outstrips supply — rohanpaul_ai · 2026-10-27