bartowski unveils per-tensor layout maps for GGUF quantization, tests show across-the-board gains
noneabove1182 · reddit · 2026-09-11
Well-known quantizer bartowski published a blog post on new per-tensor layout maps for his GGUF model uploads, reshaping how tensors are laid out in quantized models.
He avoids claiming "Pareto frontier" or "best models in the world", but says tests show the new shapes are better across the board than his previous uploads, and the work is still ongoing. Full research is on his Hugging Face blog.
More from Infra
- Anthropic S-1: training infra edge cut per-task cost 40% and doubled revenue growth — BenBajarin · 2026-10-26
- Rewriting scaling law study: optimal synthetic data share rises from 10% to 32% with compute — heghbalz · 2026-10-26
- US states halt new data centers as 72% of Americans oppose local builds — YvesMulkers · 2026-10-26
- $5M Seed Round Can't Afford One DeepSeek Training Run: GPU-less AI Startup's Three Paths — FinanceYF5 · 2026-10-26
- HBM demand shifts: low-stack inference plans shelved, Rubin to go 12-high only — BenBajarin · 2026-10-26
- CircuitHub unveils The Grid, a factory-scale robot making PCBs in the US twice as fast as Shenzhen — garrytan · 2026-10-26