Dual 3090 Qwen3.8-27B: DFlash2 Speed Test and Full Config Guide
Old_Ad_6033 · reddit · 2026-08-29
A Redditor shared a full recipe for running the Qwen3.8-27B INT4 model on dual RTX 3090s (24GB). Using a stack of vLLM 0.28.0, LMCache, and DFlash2, the setup leverages NVMe as a Level 2 KV cache to support 256k context length. Benchmarks show that with DFlash2 enabled, decode speed for Code tasks hits 268 tok/s (3.8× speedup) and real agent jobs reach 165 tok/s. The author detailed the environment specs, LMCache server startup commands, and vLLM launch parameters, noting that specific patches are required to prevent cache corruption.
More from coding & agent
- raylib 6.2 ships with 300+ improvements and 100 new contributors, 20 new API functions — jsuarez · 2026-10-16
- "Vibecoding" is as misleading a label as "AI" and "SI," dev complains — eschadiol · 2026-10-16
- Doc2Harness: New benchmark finds best coding agent passes only 53% across 329 cases — _akhaliq · 2026-10-16
- Perplexity open-sources SPACE, the Firecracker microVM sandbox behind Perplexity Computer — perplexity_ai · 2026-10-16
- Blackstone goes all-in on Factory for autonomous software development — matanSF · 2026-10-16
- Longtime Windsurf user cancels $10/month legacy plan, citing AI subscription fatigue — tristanbob · 2026-10-16