Inkling-2 Mini hits 210 tok/s on Mac Studio, builds apps 1.8x faster than Sonnet

SonglinYang4 · x · 2026-11-21

ExoLabs partnered with Thinking Machines to heavily optimize Inkling 2 Mini for local inference on Apple silicon: 210 tok/s decode and 3620 tok/s prefill on a 96GB M5 Ultra Mac Studio, and 125 tok/s decode / 1750 tok/s prefill on a 48GB M5 Max MacBook Pro.

In a test it built a native weather app 1.8x faster than Claude Sonnet 5.5 on M5 Ultra, and 11x cheaper than API pricing, with claimed Sonnet-level performance. The key is its looping architecture: reusing layers boosts inference-time compute without growing the model, ideal for memory-constrained local devices.

Related event: Inkling-2 Mini Hits 210 tok/s Locally on Apple Silicon, 11x Cheaper than Sonnet(4 posts)→

Original post →

More from coding & agent

coding & agent channel →