Unsloth guide: run Inkling 2 Mini (26.4B MoE) locally, 1-bit needs just 9GB RAM

NielsRogge · x · 2026-11-21

Unsloth published a full local-run guide for Thinking Machines Lab's Inkling 2 Mini, a 26.4B MoE (5.4B active) model under Apache 2.0, built on a Looped Transformers variant with 1M context for coding, agentic, and vision workloads.

Key facts:

Related event: Unsloth Guide: Run Inkling-2-Mini Locally with Just 9GB RAM(2 posts)→

Original post →

More from coding & agent

coding & agent channel →