vLLM v0.29.0 upgrade guide: new defaults, ten architectures removed, DoS fix
vllm_project · x · 2026-09-11
Key upgrade notes for vLLM v0.29.0:
- New defaults: MRV2 for every model, FlashInfer all-reduce for TP CUDA groups, prefixcacheretentioninterval 0 on SWA/SSM models
- MRV1 stays for a few ROCm models and not-yet-covered features
- Prefix-cache NONEHASH is now deterministic, so distributed KV cache users can drop PYTHONHASHSEED
- Ten deprecated architectures removed; FlexOlmo, Olmo3 and Hunyuan V1/VL move to the Transformers backend
- PyAV video decoder removed — use OpenCV or Torchcodec
- python -m vllm.entrypoints.openai.apiserver deprecated in favor of vllm serve
Serving/frontend highlights: Mooncake Store can offload decode KV; queue admission control via --max-num-queued-reqs/--max-num-queued-tokens; a /v1/messages/render endpoint for the Anthropic Messages API; Rust frontend adds audio/video over gRPC; bounded cachesalt length closes a scheduler CPU exhaustion DoS.
Related event: vLLM v0.29.0 Cuts Blackwell Latency 33.6%, Model Runner V2 Default(4 posts)→
More from Infra
- Taiwanese families at TSMC's Arizona plant are shocked US high school is 'so much easier' — Polymarket · 2026-10-27
- OpenRouter hits 1 trillion tokens per day — ycombinator · 2026-10-27
- Engineer reverse-engineers Canon printer firmware to kill ink counters and proprietary cartridges — ngxson · 2026-10-27
- AI Cloud Operators Sell Years of Compute Yet Struggle to Finance Delivery — AccBalanced · 2026-10-27
- Modal engineer's deep dive into how vLLM and SGLang inference engines work — charles_irl · 2026-10-27
- TSMC reportedly preparing another CoWoS price hike of up to 20% as AI packaging demand outstrips supply — rohanpaul_ai · 2026-10-27