Inkling-2-mini (~25B) runs on one RTX 3090, early test says it beats bigger MoE model

LiTianleli · x · 2026-11-22

A user tested thinkymachines' Inkling-2-mini: a 25B model running locally on a single RTX 3090 with the Unsloth UD-Q4KXL quant. Asked to one-shot build a floating island in snowy weather (no harness, no tool calls), it used only 23,600 tokens (2,891 thinking + 20,709 answer) for a high-quality result. The author compared it against Hy4-Flash via API and found Mini's output clearly better — notable news for local AI, though more testing is needed.

Original post →

More from Models

Models channel →