Unsloth ships 44.5GB quants of Ornith-1.5-122B, 82% smaller with ~84% accuracy

danielhanchen · x · 2026-10-21

Unsloth released UD dynamic quantized GGUFs for Ornith's new 122B model. The UD-Q2KXL quant is just 44.5GB versus 249GB at BF16 (82% smaller) while retaining roughly 84% top-1 accuracy on wikitext general tasks and 89% on chat. A full benchmark curve across quant levels (IQ1M through Q80) is included for picking a tier by VRAM budget.

Related event: Unsloth Releases Quantized GGUF of Ornith-1.5-122B(2 posts)→

Original post →

More from Models

Models channel →