Inkling-2-Mini runs on laptops with as little as 9GB RAM, per Unsloth local guide

NielsRogge · x · 2026-11-21

NielsRogge points to a new UnslothAI guide for running Thinking Machines Lab's Inkling-2-Mini locally on a laptop, noting it needs as little as 9GB of RAM depending on quantization size.

Memory requirements by quantization level:

Higher-bit versions perform better but use more memory and can slow inference. The author personally runs the 3-bit version on his MacBook.

Related event: Unsloth Guide: Run Inkling-2-Mini Locally with Just 9GB RAM(2 posts)→

Original post →

More from Infra

Infra channel →