Minima quantizes all 496 layers of Qwen3.8-27B to NVFP4 W4A4, matching BF16 at 2.9x smaller
pbaylies · x · 2026-09-05
A paper highlighted by HuggingPapers argues the recurrent half of a hybrid LLM is actually easy to quantize. Minima quantized all 496 linear layers of Qwen3.8-27B — including the Gated DeltaNet layers — to NVFP4 W4A4, matching BF16 performance while cutting model size by 2.9x.
Related event: Minima Quantizes 27B Hybrid LLM Fully to NVFP4 W4A4(2 posts)→
More from Infra
- BaseQuant V1 quants for agentic Qwen3.8-27B hit 17-34% lower KL than Unsloth — nightowlsleeping · 2026-10-23
- PhD students in some countries get B200s on demand, unlike their US peers — HildeKuehne · 2026-10-23
- Nvidia's Berlin GTC spotlights humanoid robots and Vera Rubin AI supercomputing — emmanuelvivier · 2026-10-23
- Lenovo adds 5 AI Library use cases, claims 1-week deployment and up to 70% lower token cost — shashib · 2026-10-23
- Your kernel doesn't need to beat cuBLAS on every shape, argues GPU dev — blelbach · 2026-10-23
- llama.cpp team launches Llama: one-click local AI on your Mac menu bar — Hugging Face · 2026-10-23