Troubleshooting Qwen3.8 Flash Next on Mixed NVIDIA/AMD Hardware
Designer_Elephant227 · reddit · 2026-08-31
A user is attempting to run Qwen3.8 Flash Next locally on a mixed GPU setup (RTX 5070 Ti 16GB + Radeon AI PRO R9700 32GB + 96GB RAM) but is facing issues. They previously ran the 27b model successfully (q8 quantization, 256k context, 40tok/s). Current challenges include an AMD Pro driver unload bug causing system freezes and Claude incorrectly estimating the MoE model's VRAM requirements. The author is seeking advice on specific quantization choices, token speeds, launch flags, and handling the mixed NVIDIA/AMD environment.
More from Infra
- RL train-sample systems are frontier AI's hardest infra problem — and a trade secret — brianryhuang · 2026-10-16
- Local tuning of GLM-5.3-Flash on 2×GB10 lifts decode from 49 to 58 tok/s — EAccelerate_42 · 2026-10-16
- 3x DGX Spark cluster runs GLM-5.3-Flash locally behind a proxy, 1.75M tokens/day at 119W — Teknium · 2026-10-16
- Optuna creator Akiba: when 2 hyperparameters cost $20M, what's left for BO/HPO — Stefania_druga · 2026-10-16
- Amazon Proposes Per-Request Validated Evidence Caching for Production RAG — _reachsumit · 2026-10-16
- LinkedIn's TransX report: sequence transduction for recsys, +6.02% CTR in A/B tests — _reachsumit · 2026-10-16