Unsloth Guide: Run Inkling-2-Mini Locally with Just 9GB RAM

Unsloth released a guide for running Thinking Machines Lab's Inkling-2-Mini (26.4B MoE, Apache-licensed) locally, with the model needing as little as 9GB RAM and a 4-bit quantized version at 17.6GB.

2026-11-21 ~ 2026-11-21 · 2 related posts