4x RTX 3090 advice: keep Qwen 27B Q8 or switch to Qwen Next Flash
Zyj · reddit · 2026-09-19
The author is upgrading a Threadripper Pro 5955WX / 128GB DDR4 server from two to four RTX 3090s, currently serving a few users with Qwen 3.8 27B Q8 on vLLM.
The dilemma: keep running the 27B Q8 and use spare VRAM for smaller parallel models, or switch to Qwen 3.8 Next Flash at Q4/Q5 (which fits but may not be universally better). The Club 3090 multi-GPU doc is called out as horribly outdated. They're asking the community for recommendations.
More from Infra
- ByteDance details USDB storage system: 85.8% lower write latency for recommender sequences — _reachsumit · 2026-11-04
- Oracle cancels $7B chip leasing deal with Tencent, FT reports — SumitGup · 2026-11-04
- Inference engine shrunk to 1023 bytes, still runs SmolLM2-135M — cneuralnetwork · 2026-11-04
- Musk says space data centers are 'looking pretty appealing right now' — elonmusk · 2026-11-04
- Data centers are turning to old jet engines as the wait for power grows — IndependentCoast3974 · 2026-11-04
- Intel may discontinue Arc B580 to prioritize higher-margin Arc Pro cards as B70 prices rise — chemist_slime · 2026-11-04