New Qwen3.8 27B quants beat ISTA and Unsloth byte-for-byte on three corpora
Dutchnamn · reddit · 2026-09-23
A Redditor released AP-GGUF quants of Qwen3.8 27B that beat ISTA and Unsloth quants by a wide margin byte-for-byte on three corpora (KLD and top-1% tested 3x). Generated over a week of continuous GPU/CPU time on a single Strix Halo; available on Hugging Face.
More from Infra
- ALP encoding officially lands in Apache Parquet with zstd-level compression and faster decoding — mgill25 · 2026-09-23
- DiffusionGemma hits 97 tok/s single-stream and 317 tok/s at concurrency 32; vLLM patches landing — GlennCameronjr · 2026-09-23
- Your life at every level of running AI locally, from laptop to 4x3090 — ZachCope · 2026-09-23
- Intelligence may become abundant before power plants and fabs can keep up, argues thread — r0ck3t23 · 2026-09-23
- Cloudflare CTO Dane Knecht makes TIME's exec list, rebuilding web for AI agents — michellechen · 2026-09-23
- Parakeet.java ports NVIDIA's Parakeet ASR to pure Java, transcribing 15-min speech in ~15s — mukel90 · 2026-09-23