Local test: Inkling 2 mini runs 5-10x slower than Qwen and fails agent tasks
Mrinohk · reddit · 2026-11-22
A r/LocalLLaMA user tested Inkling 2 mini (UDQ4KXL) in their personal assistant harness (RAG, smart home, bash across machines) as a Qwen3.6 35B replacement, with disappointing results.
- Speed: 5-10x slower than Qwen on P100s (20-25 t/s vs 150-200 generation), attributed to the looped transformer; spec decode acceptance too low to help.
- Test 1 (summarize the state of a project car from hundreds of small RAG memories): fine, a mostly solved problem.
- Test 2 (find a rare part and open the link on the Mac): never succeeded once; searched for wrong parts like wiper blades, possibly weak world knowledge.
- Baselines: Qwen3.6 35B completes nearly every time but degrades past 30k tokens; Gemma4 26B completes tasks but overthinks and holds persona best; early Gemini 3 Flash solved it.
The poster questions the community hype of "Qwen3.8 27B-level capability" and suspects non-SWE use cases expose the model's shortcomings.
More from Models
- Inkling 2M compared to Mistral 7B: "we didn't know what this weight class allowed" — teortaxesTex · 2026-11-22
- Tesla FSD V15 live-perception demo in downtown Toronto sparks debate — gnukeith · 2026-11-22
- Inkling 2 Mini trails Qwen3.8-27B; its "suspicion" traced to 32 neurons — FeydRowan · 2026-11-22
- Gemini 4 Neon tops AI Chess Leaderboard at 1924 Elo as Google sweeps top 8 — sahandsharif · 2026-11-22
- Thinking Machines' Inkling-2-Mini GGUF quantization trends on Hugging Face — AtomicChat · 2026-11-22
- Backend logs show "GPT-6.2 Astra" routes everything to 6 Astra with zero 6.2 usage — bdsqlsz · 2026-11-22