SWE-bench cost analysis: tiny Inkling 2 Mini costs 3-5x more per task than DeepSeek V4.1 Flash

hyudryu · reddit · 2026-11-22

A Redditor cost-audited the hyped Inkling 2 Mini. Locally it's excellent: 4500 tok/s decode with 32 concurrent coding sessions (140 tok/s each) on 2x RTX Pro 6000. But on a 200-problem SWE-bench subset across three harnesses (Kimi Code / Deepseek / OMP), the cost pattern is stark: pass rates 72.5-73.5% vs DeepSeek V4.1 Flash's 77.0-80.5%; 2x the model calls (16.7-19.3k vs 8.7-9.4k) and far more input tokens (e.g. 1.45B vs 529M under Kimi Code); and per-task API cost of $23.11-29.88 vs DeepSeek's $6.11-7.68 — the smaller model ends up 3-5x more expensive. Takeaway: small models' higher call counts and token burn can wipe out their price advantage.

Original post →

More from coding & agent

coding & agent channel →