How to locally run a Qwen 3.8 Next model at Claude Opus level for under $4,000
ironicstatistic · reddit · 2026-09-17
A Reddit user asks for deployment advice on building a dual-GPU local server to run a Q3 quant of Qwen 3.8 Next (85GB with KV cache) at 256k context, targeting Claude Opus-class intelligence with 500 tok/s prefill and 20 tok/s decode on a $4,000 budget.
Four candidate builds:
- Cheap/old: 2-3 used Tesla V100 32GB ($2,000) — affordable but aging
- AMD Strix Halo 64GB + RTX 5060 Ti 16GB ($3,500): iGPU fast RAM for experts, discrete GPU for attention via Vulkan — likely best value
- Intel: 2× Arc Pro B70 with a vLLM fork ($3,200), but probably slower
- Premium: 2× RX 7900 XTX on ROCm ($4,100), fastest and most future-proof
His thesis: with optimizations like n-gram spec decoding, mid-tier Opus-class models are becoming the realistic local-deployment target.
More from Infra
- One CPU Core Inspects 28.8M Packets/Sec: How XDP Rewrites Network Processing — blaizedsouza · 2026-09-17
- Dev's Rust/Wasm AAC Encoder Beats FFMPEG by 4-6x in Benchmarks — wavefnx · 2026-09-17
- OpenRouter weekly tokens surge 25,000% to 126.2 trillion — the AI bubble debate in one chart — The Decoder · 2026-09-17
- How do you verify an untrusted GPU host actually ran the model? Gonka's design notes on 3 cheating vectors — autoimago · 2026-09-17
- Lenovo launches ThinkAgile VX850 V4 servers that let apps stay on VMware or Hyper-V — shashib · 2026-09-17
- Running an Opus-level coding agent locally: MTPLX claims 126.5 TPS on Mac — julianharris · 2026-09-17