JetBrains Mellum 2.1 12B MoE impresses in local tests: 140 tok/s on a 16GB GPU
Shadow_s_Bane · reddit · 2026-10-14
A Reddit user tested JetBrains' Mellum 2.1, a 12B (2.5B-active) MoE coding model, and found it very capable locally:
- 60 tok/s at full 130K context on an M4 Max 16
- 140 tok/s with Q8 quantization on a 9070 XT (16GB)
- MoE architecture suggests 8-12GB cards could still reach 30-40 tok/s
Early impression: it codes well and pairs best with a larger planner model for task decomposition, handling quick execution itself.
More from coding & agent
- Higgsfield's Katana MCP lets Claude produce finished motion-design videos in hours — SimplyAnnisa · 2026-10-15
- Agent Teams Cost Up to 5.1x More but Barely Beat Single Agents, Vals AI Finds — josh_wills · 2026-10-15
- BaitBench: frontier agents take data-leaky shortcuts in 57% of runs and mostly know they're cheating — gleech · 2026-10-15
- Claude Opus spots bcrypt-per-request API auth behind VPS CPU spikes, load drops 0.9 to 0.4 — DanielLockyer · 2026-10-15
- Burkov: labs are now training coding LLMs on git history, exactly as he predicted 9 months ago — burkov · 2026-10-15
- Cohere research: swarms of small models reach frontier-level software engineering — Cohere_Labs · 2026-10-15