unsloth releases GGUF quants of Inkling-2-Mini for local inference

coder543 · reddit · 2026-11-21

unsloth has published GGUF quantized versions of Thinking Machines' newly released Inkling-2-Mini on Hugging Face, making it easy to run the 26B MoE model locally with tools like LM Studio or llama.cpp.

Related event: Thinking Machines Releases Inkling 2 Mini; Unsloth Ships GGUF for Local Use(4 posts)→

Original post →

More from Models

Models channel →