Qwen3.8-27B EXL3 quant hits lowest KLD of 0.0002 in just 23 GB
suprjami · reddit · 2026-10-29
A Reddit user highlights yeasah's new EXL3 quant of Qwen3.8-27B (6bpw), which achieves the lowest measured KLD mean of 0.0002 while using only 18.8 GiB of VRAM for weights.
Comparison: Unsloth Q8KXL at 0.0005 (31.5 GB), Minachist INT8 AutoRound attn-bf16 at 0.00056 (36.9 GB), turboderp 6bpw SC at 0.0006 (23 GB). The yeasah quant beats all of them in fidelity at a smaller file size.
More from Infra
- Qwen3.8 Flash Next at IQ3_S hits 275 tok/s on a single RTX 5080 via Basalt fork — yehyakar · 2026-10-29
- Google Cloud CEO: Apple Scaling Foundation Model Pretraining on Latest TPUs — shayan_ · 2026-10-29
- FlashAttention vs standard attention in one chart: the bottleneck is data movement, not compute — cneuralnetwork · 2026-10-29
- Particle-1 inference goes live on OpenRouter, claiming 28-52% fewer output tokens — ycombinator · 2026-10-29
- MLX-Serve 26.11.1 rewrite: plugin architecture adds models and quants without recompiling — TheMoonMidas · 2026-10-29
- Movistar and Orange activated Starlink coverage after deadly Spain train crash — elonmusk · 2026-10-29