vLLM nightly adds PLE disk offload, with a telling [Qwen4Exp] tag on the PR
rmhubbert · reddit · 2026-10-31
vLLM has landed PLE disk offload support in nightly builds via PR #59958 (+598/-23, 21 commits). Notably the PR is tagged "[Qwen4Exp]", suggesting the feature targets experimental deployments of a next-gen Qwen model — an early hint of Qwen4.
More from Infra
- SenseNova-U1.5-8B hits 125 tok/s on M5 Ultra in llama.cpp and spots a $1 receipt error — Binary_orchid · 2026-10-31
- Cloudflare Durable Objects now defer code updates up to 300s by default — irvinebroque · 2026-10-31
- Intel plunges 29%, falling below its 2000 dot-com era peak after 26 years — mitchdeg · 2026-10-31
- Clover-35B-A3B Quantized to 29.4 GB Runs at ~42 tok/s on a 64 GB Mac — viveky259 · 2026-10-31
- Liquid Agent brings fully local LFM3 agent to Linux with one-command install — JosephJacks_ · 2026-10-31
- A fully local office AI stack: MiniCPM, Qwen3, LFM2.5 and Whisper — HowDevelop · 2026-10-31