vLLM ships day-0 support for Qwen-Image-2.1 with cross-step prefix KV cache
Alibaba_Qwen · x · 2026-09-20
vLLM announced day-0 support for Qwen-Image-2.1, which Alibaba's Qwen team thanked them for. The model pairs a 7.1B single-stream DiT (block-causal attention) with a Qwen3-VL-8B text encoder and a 16x RGBA autoencoder, serving both text-to-image and editing in one pipeline. vLLM-Omni accelerates it via cross-step prefix KV cache reuse, dedicated CUDA Graphs, continuous batching, tensor/Ulysses sequence parallelism, FP8 weights and CPU offloading. Recommended defaults: 40 steps, cfg-scale 1.0.
More from Infra
- Agent Substrate Calculator Estimates Session Resume Speed Under Load — pjausovec · 2026-11-12
- Dell expands AI Data Platform: agents have a data-context problem, not a model problem — DavidLinthicum · 2026-11-12
- SGLang Megakernel Pushes Muse Spark to 1,109 tok/s, 2.1x Over Baseline — hsu_byron · 2026-11-12
- Potion UI's local login system turns your PC into a multi-user AI server — cocktailpeanut · 2026-11-12
- AWS Finally Built Its Own AWS Emulator — super_linear · 2026-11-12
- Megakernel is multiprogramming for GPUs: 'GPUs are entering the CPU age' — pranjalssh · 2026-11-12