Inkling 2 Mini on 2× RTX 3090: 557K context + vision at ~100 tok/s with NInfer-all

Sisuuu · reddit · 2026-11-22

A detailed hands-on report of running Thinking Machines' Inkling 2 Mini (26.4B looped MoE, 3.4B active) locally on 2× RTX 3090 without NVLink/P2P:

Original post →

More from Infra

Infra channel →