vLLM v0.34.0 Lands: 1,061 Commits, Up to 1.95x Faster Decode on GB200

vllm_project · x · 2026-11-19

vLLM v0.34.0 is out, bundling 1,061 commits from 412 contributors (120 new):

Upgrade notes: default block size is now 64 (was 16; ROCm paged attention still 16), ROCm 7.2 images are gone, and huggingfacehub >= 2.0.0 is required. These changes can break existing setups; migration steps are documented.

Original post →

More from Infra

Infra channel →