Inkling 2 Mini edges Qwen 3.8 27B on coding (277 vs 272) but struggles on PC hardware
Ubunta · x · 2026-11-21
Tested on a Minisforum mini PC (Ryzen AI 9 HX 370, Radeon 890M iGPU, 89GB RAM, Linux) at 4-bit (17GB), Inkling 2 Mini shows real code quality: it beat Qwen 3.8 27B on a hard hidden-assert coding suite (277 vs 272) with cleaner code, but was slower (23 vs 16 min), used more tokens (11,704 vs 10,157), and was painful to set up — Ollama doesn't support PC yet; it needed Unsloth's llama.cpp fork on ROCm or mainline llama.cpp plus unmerged PR #32704 on Vulkan. Despite only 3.4B active params, running middle layers 3x per token caps it at 9–10.5 tok/s on a 120GB/s bus; Macs and Strix Halo hit 17–27 tok/s thanks to 2–5x bandwidth. Qwen remains the author's daily driver.
More from Infra
- Inkling 2 Mini on PC: edges out Qwen 3.8 27B on coding tests but painful to run — Ubunta · 2026-11-21
- Inkling-2-Mini runs on laptops with as little as 9GB RAM, per Unsloth local guide — NielsRogge · 2026-11-21
- Only when infra resources burn out will the application layer see its spring — yangyi · 2026-11-21
- 26 LLM routers caught injecting malicious tool calls, draining a client's $500k wallet — 0xkarasy · 2026-11-21
- OpenRouter accused of sending users' BYOK private keys to China despite earlier denials — 0xkarasy · 2026-11-21
- OVH's Olala Mini 7A1B: 360 tok/s decode on one RTX 5090, 96K context, v2.0 to exceed 100B — JiliJeanlouis · 2026-11-21