Unsloth Releases Extreme Quantization for Kimi K3, Starting at 466GB
Hannibalj2ca · reddit · 2026-08-07
The Unsloth team has released new GGUF quantized versions of the Kimi K3 model. This update includes several extreme compression formats, with the smallest UD-Q10 version reduced to 466GB. Other options like TQ10 (509GB), IQ1M (649GB), and TQ20 (551GB) are also available, providing more choices for local deployment environments with varying VRAM capacities.
More from Models
- Opus 5.5 turns heads with surprisingly polished vertical video demo — FinanceYF5 · 2026-10-16
- Astra 6.1 may arrive before end of month, reads dev's 'we are cooking' tease — haider1 · 2026-10-16
- Open-source OCR model indra-ocr trends on Hugging Face with CPU support — datalab-to · 2026-10-16
- Xiaohongshu's Vela 35B turns anonymized user behavior into supervision, gains +11.5 on VelaBench — AdinaYakup · 2026-10-16
- KOL: No better model than Anthropic's Opus right now, its magic is back — kimmonismus · 2026-10-16
- Users blast Gemini in Chrome's 'draconian' usage caps: memory costs 2-4% per use — North-American · 2026-10-16