Inkling 2 Mini: a 26B looped MoE that runs agentic workloads locally at 168 tok/s

ying11231 · x · 2026-11-21

ThinkyMachines released Inkling 2 Mini, answering community feedback that Inkling 2 Small (594B) was too big.

The SGLang team boosted the release, noting they put significant work into optimizing it for local devices.

Related event: Thinking Machines Releases 26B Looped Transformer Inkling 2 Mini, Runs on Laptops(115 posts)→

Original post →

More from Infra

Infra channel →