Inkling-2 Mini adapts its thinking depth to task size, runs locally at 91 tok/s on RTX 3090

LiTianleli · x · 2026-11-22

Hands-on with Thinking Machines' Inkling-2 Mini highlights its adaptive thinking budget: small tasks finish thinking in under 10k tokens, bigger prompts get more reasoning without looping — unlike many models that apply uniform effort regardless of task size. It runs fully locally (not via API): the Unsloth UD-Q4KXL quant on an RTX 3090 via superalesha's Maya fork at 91 tok/s, with the fork merging into mainline Maya soon. Screenshot shows 0 failed runs, 1.7k tok/s prefill, one 24-minute answer with 67,432 thinking tokens.

Original post →

More from Models

Models channel →