bartowski unveils per-tensor layout maps for GGUF quantization, tests show across-the-board gains
noneabove1182 · reddit · 2026-09-11
Well-known quantizer bartowski published a blog post on new per-tensor layout maps for his GGUF model uploads, reshaping how tensors are laid out in quantized models.
He avoids claiming "Pareto frontier" or "best models in the world", but says tests show the new shapes are better across the board than his previous uploads, and the work is still ongoing. Full research is on his Hugging Face blog.
Related event: Bartowski Unveils Per-Tensor Layout Maps for GGUF Quantization(2 posts)→
More from Infra
- NVIDIA ships NVFP4-quantized Qwen3.8-27B, trending on Hugging Face — nvidia · 2026-09-11
- Qwen 3.8 125B-A6B runs 15.3% faster on Mac via speculative decoding on mlx.fast — TheMoonMidas · 2026-09-11
- Olam Labs CEO: only compute and data remain as bottlenecks to AGI — garrytan · 2026-09-11
- Open-sourced inference acceleration for structure-based models ships benchmarked and documented — AllThingsApx · 2026-09-11
- NVIDIA's $89B quarterly data center revenue means compute is no longer an IT expense — PeterDiamandis · 2026-09-11
- Pure-CPU DeepSeek V4.1 Inference Project Hits 6 TPS on a Xeon for Overnight Agent Jobs — Qwen30bEnjoyer · 2026-09-11