FP4 quant of Qwen3.8-Flash-Next shrinks model to 102GB
rerri · reddit · 2026-10-16
Reddit user rerri released an FP4 QAD quantization of Nvidia's Qwen3.8-Flash-Next, weighing in at just 102GB versus 133GB for the official nvidia/Qwen3.8-Flash-Next-NVFP4 checkpoint. The author hopes the model-specific inference engines will add support for this format soon, making local deployment even cheaper.
More from Infra
- Meta picks Apple's MLX as preferred local inference platform; Muse Spark Open runs on two M5 Ultra Mac Studios — awnihannun · 2026-10-16
- Hugging Face scales Indic pretraining with 2.8T tokens and an open data pipeline — Hugging Face Blog · 2026-10-16
- First AA-AgentPerf results: NVIDIA Vera Rubin NVL72 delivers up to 5.7x throughput per MW vs GB300 — ArtificialAnlys · 2026-10-16
- Vera Rubin NVL72 first benchmarks: up to 5.7x throughput per MW vs GB300 — ArtificialAnlys · 2026-10-16
- NVIDIA Vera Rubin NVL72 hits up to 5.7x GB300 throughput per MW on agent benchmark — ArtificialAnlys · 2026-10-16
- 14 open-source LLM observability tools to know in 2026, from Langfuse to Laminar — TheTuringPost · 2026-10-16