tenz losslessly compresses GGUFs by up to 13%, saving 80-130GB per 1TB archive
Simpli-curious · reddit · 2026-11-16
A Reddit developer released tenz 0.25, a lossless compressor for GGUF/safetensors model files—decompressed files are byte-for-byte identical, so llama.cpp, Ollama and LM Studio load them as before. It's a single dependency-free C file, developed and benchmarked on a Poco F5 phone in Termux.
Results
- A 1TB GGUF archive shrinks by roughly 80–130GB
- Qwen3.5-2B Q4KM: 8.53% saved vs 2.07% for zstd -19, 1.78% for xz -9, and 4.17% for Aqueous; compress+decompress takes 17s on the phone (zstd alone took 4 minutes)
- Q4KM across 9 models: 7.6–9.2%; Gemma-4-31B QAT Q40: 12.7%; BF16: 34%; tokenizer metadata compresses 80% smaller
How it works: general compressors fail on quantized weights because they look random; tenz parses the GGUF, unpacks each block into real quantized values and scales, and codes them with context models fitted to the file, using rANS from static tables so decoding needs no learning. An experimental OpenCL GPU path on the phone's Adreno 725 hit 150 MiB/s—still slower than the big CPU cores (250 MiB/s)—and had to work around a driver byte-store bug.
Caveats: pre-release files only decompress with the creating version; decoding is slower than zstd (7s per 1.2GB on phone); gains apply mainly to model files. Code and full tables on GitHub.
More from coding & agent
- Agentic harnesses hit a plateau: "the ceiling on intelligence is the model" — alexisgallagher · 2026-11-16
- QuixiVoice: a Rust voice stack for any agent, from VAD to TTS in one pipeline — QuixiAI · 2026-11-16
- Music video made with Claude Code driving Blender: physics-solver dolphin animation — maximstark_ · 2026-11-16
- Spend tokens on verification, not generation: poteto's talk on shipping quality, not slop — gnukeith · 2026-11-16
- Alibaba open-sources open-code-review, a hybrid AI code reviewer with 52k GitHub stars — abhishek__AI · 2026-11-16
- Gemini agent's Auto permissions mode asks per-file approval instead of per-directory — BenBlaiszik · 2026-11-16