BaseQuant V1 quants for agentic Qwen3.8-27B hit 17-34% lower KL than Unsloth
nightowlsleeping · reddit · 2026-10-23
Base Compute released BaseQuant V1, quantized GGUF builds of Qwen3.8-27B targeting agentic workloads, in three sizes: 10.93, 16.41, and 20.82 GB.
On their held-out tests, the quants show 17-34% lower KL divergence from BF16 than similarly sized Unsloth quants, meaning closer fidelity to the original model at smaller footprints. The team is soliciting feedback from real-world workloads.
More from Infra
- PhD students in some countries get B200s on demand, unlike their US peers — HildeKuehne · 2026-10-23
- Nvidia's Berlin GTC spotlights humanoid robots and Vera Rubin AI supercomputing — emmanuelvivier · 2026-10-23
- Lenovo adds 5 AI Library use cases, claims 1-week deployment and up to 70% lower token cost — shashib · 2026-10-23
- Linux Kernel Module Unlocks Half-Speed Tensor Cores on RTX 3090, Boosting BF16 to 1.9x — UltramanQuar · 2026-10-23
- Your kernel doesn't need to beat cuBLAS on every shape, argues GPU dev — blelbach · 2026-10-23
- llama.cpp team launches Llama: one-click local AI on your Mac menu bar — Hugging Face · 2026-10-23