Running Qwen 3.8 Flash Next on 2x CMP 170HX mining GPUs, config shared
leonbollerup · reddit · 2026-10-25
Reddit user leonbollerup shares a vLLM setup for running Qwen 3.8 Flash Next on two NVIDIA CMP 170HX mining GPUs, tuned for optimal quality and performance, with the full config open-sourced on GitHub (inordic/cmp170hx-vllm-qwen38-flash-next).
More from Infra
- Running big models on a single RTX 4090: INT8 weights, FP8 decoder, RAM tiering — AIFlow_ML · 2026-10-25
- ByteDance, Alibaba and Tencent order 3M+ Nvidia RTX PRO 5500 cards worth $35B+ — Miles_Brundage · 2026-10-25
- Nebius hits 67B tokens/day on OpenRouter, but rivals process up to 2T daily — AccBalanced · 2026-10-25
- OpenRouter analysis finds evidence of spoofing-style price manipulation by inference providers — AccBalanced · 2026-10-25
- EmbeddedLLM receives AMD MI350X server donation to advance vLLM ROCm work — AccBalanced · 2026-10-25
- 106 Tesla Megapacks to replace a former Belgian coal plant with 400 MWh storage — XFreeze · 2026-10-25