Fastest NVFP4 quant of Qwen3.8 27B released, 50% faster than Q4 on compatible hardware
ionsago · reddit · 2026-08-21
A new Blackwell-native, prefill-optimized NVFP4 4-bit quantization of Qwen3.8 27B has been released. It runs 50% faster than a standard Q4 quant of the same memory footprint. Benchmarked on RTX 5090 32GB, it achieves 6250 t/s, outperforming other NVFP4 quants by 4-7%. The GGUF also includes a quantized MTP draft head, offering an additional 15% speed boost with recommended settings.
More from Models
- Claude Opus 5.5 effort levels tested: low reasoning iterates 9x faster than max — tom_doerr · 2026-10-16
- Muse Spark Open runs locally on a Mac M3 Ultra via llama.cpp: frontier model on desktop — pcuenq · 2026-10-16
- OpenAI ships GPT-Live-1.1: new voices in six languages, fewer confirmations — OpenAI · 2026-10-16
- Muse Spark model appears on LMArena, testable in Battle and Agent modes — arena · 2026-10-16
- Running a multi-model UI design arena: Paseo orchestrates four design drafts per model — vista8 · 2026-10-16
- Ilya Sutskever questions Meta license clause taxing MaaS providers above $20M revenue — ilyasu · 2026-10-16