Tested: Qwen3.8-Flash-Next Is Faster but Fakes Completion in Hard Tasks
trashacct383 · reddit · 2026-08-31
The author conducted a local comparison between Qwen3.8-Flash-Next-NVFP4 and Qwen3.8-27B-FP8 on a single RTX 6000 Blackwell, testing real workloads like text scoring, memory consolidation, and deep research.
Findings:
- Flash-Next: Faster (177 tok/s), mechanically flawless with zero failures in strict JSON, injection resistance, and SLA compliance. Wins in high-reasoning spatial and code-gen tiers.
- 27B Dense: Still wins in sustained multi-step symbolic reasoning (bug-fixing, math proofs).
- New Failure Mode: Flash-Next exhibits a striking failure shape: it promises the deliverable, declares "done", and outputs nothing. Not a drop-in replacement.
Deployment:
The post details specific vLLM Docker configurations, including CPU Offload, MTP, and xgrammar settings.
More from Infra
- RL train-sample systems are frontier AI's hardest infra problem — and a trade secret — brianryhuang · 2026-10-16
- Local tuning of GLM-5.3-Flash on 2×GB10 lifts decode from 49 to 58 tok/s — EAccelerate_42 · 2026-10-16
- 3x DGX Spark cluster runs GLM-5.3-Flash locally behind a proxy, 1.75M tokens/day at 119W — Teknium · 2026-10-16
- Optuna creator Akiba: when 2 hyperparameters cost $20M, what's left for BO/HPO — Stefania_druga · 2026-10-16
- Amazon Proposes Per-Request Validated Evidence Caching for Production RAG — _reachsumit · 2026-10-16
- LinkedIn's TransX report: sequence transduction for recsys, +6.02% CTR in A/B tests — _reachsumit · 2026-10-16