Running 180B Qwen3.8-Flash-Next at 40-50 t/s on 64GB RAM + 16GB VRAM with Strata
danamir_ · reddit · 2026-10-03
A detailed hands-on report of running Qwen3.8-Flash-Next (180B total params: 125B with 6B activated, plus 51B n-gram embedding and 4B MTP) locally via Strata. On a Windows 10 machine with 64GB RAM and a 5070Ti (16GB VRAM), the IQ3XXS quant runs at 40-50 t/s with up to 256K context.
Key points:
- Strata handles model loading/unloading automatically between prompting sessions (2 min load), letting users run ComfyUI in between for image work.
- Adding the mmproj enables vision capabilities; 32-64K context suffices for use as an image assistant.
- Alternative: run directly on llama.cpp with --cpu-moe, but expect roughly half the speed.
Related event: Strata Lets Consumer PCs Run 180B Models Locally(3 posts)→
More from Infra
- Investor: market hates uncertainty more than money after Nvidia earnings — MartinGTobias · 2026-11-19
- Microsoft and Intel deepen Azure collaboration: EMIB packaging, Diamond Rapids Xeons, 2.3x CXL gains — ryanshrout · 2026-11-19
- SGLang ships Day-0 serving support for new model DaisyRose-27B — ying11231 · 2026-11-19
- Linux LTS patch flood: 3318 patches for 6.6 alone, 'no way humans are reviewing this' — pkqzy888 · 2026-11-19
- DaisyRose-27B's in-house sandbox: ~80% cheaper than cloud providers, 99.95% success rate — BanghuaZ · 2026-11-19
- Tencent's 220B Hy4-flash quantized to 49 GB weights, runnable on 64 GB VRAM — gladkos · 2026-11-19