Unsloth Guide: Run Inkling-2-Mini Locally with Just 9GB RAM
Unsloth released a guide for running Thinking Machines Lab's Inkling-2-Mini (26.4B MoE, Apache-licensed) locally, with the model needing as little as 9GB RAM and a 4-bit quantized version at 17.6GB.
2026-11-21 ~ 2026-11-21 · 2 related posts
- Inkling-2-Mini runs on laptops with as little as 9GB RAM, per Unsloth local guide — NielsRogge · 2026-11-21
- Unsloth guide: run Inkling 2 Mini (26.4B MoE) locally, 1-bit needs just 9GB RAM — NielsRogge · 2026-11-21