vLLM v0.31.0 Ships CRIU Snapshots and Preload to Kill Cold Starts

vLLM v0.31.0 landed with 717 commits from 307 contributors, adding a preload daemon that keeps quantized weights resident in GPU memory and CRIU-based snapshots that turn cold starts into process-level restores.

2026-10-07 ~ 2026-10-07 · 3 related posts

1 near-duplicate retellings: AccBalanced