vLLM ships Day-0 support for Mistral Large 4 on NVIDIA Blackwell
vLLM Blog · rss · 2026-10-29
The vLLM blog announces Day-0 support for Mistral Large 4, including sparse MLA attention, cross-layer KV sharing, DSpark speculative decoding, DCP/PCP long-context support, and NIXL prefill/decode disaggregation on NVIDIA Blackwell — so users can self-host the 1T open model from day one.
More from Infra
- Cloudflare developer users grow 10x in 3 years, from 1M to 10M — yihui_indie · 2026-10-30
- Amazon guides AWS to 40%+ growth through 2028, eyes $1T business in 5-10 years — mitchdeg · 2026-10-30
- By 2028, 'country of geniuses in a datacenter' will be limited only by datacenter count — timshi_ai · 2026-10-30
- 797GB of CPU-side n-gram lookups match 57% more compute on 1B LM training — PangWeiKoh · 2026-10-30
- Redditor jokes about finding racks of idle GPUs at a local data center — Beneficial-Ad-8127 · 2026-10-30
- Intel shares plunge 20% as AI-driven memory shortage hurts its PC chip business — pstAsiatech · 2026-10-30