Redditor converts on Qwen 3.8 Flash Next: quantized local run rivals last year's pro models
sshwifty · reddit · 2026-10-21
Redditor sshwifty finally gave in and tried Qwen 3.8 Flash Next via strata at IQ4 XS quantization, and was blown away. His previous daily driver was Qwen 3.8 27B at Q6 kv8, but he says Flash Next 'feels like models I was using professionally last year, good enough to do just about anything.'
Not perfect, but a notably positive local-deployment data point for the quantized community — 'You all are a bad influence,' he quipped.
More from Infra
- Crusoe unveils Tinker API-compatible LLM post-training platform at PyTorch Conference — PyTorch · 2026-10-22
- Open PR optimizes DeepSeek-V4.1 inference on RTX PRO 6000 Blackwell — AlpinDale · 2026-10-22
- vLLM adds day-0 support for Flint: 500 TPS on a single GB200 — _rockt · 2026-10-22
- Grass founder on the Delphi Podcast: training data is now a profitable business serving top labs — grass · 2026-10-22
- DeepSpeed details AutoSP, Muon optimizer, and AutoTP/AutoEP advances at PyTorchCon — PyTorch · 2026-10-22
- Eureka Machine writes a Metal megakernel fusing Flint's entire decode pass — cong_ml · 2026-10-22