Community benchmark V2: 13 local models on 5 coding tasks, one 16GB GPU
Ok_Substance2327 · reddit · 2026-10-24
A r/LocalLLaMA user published V2 of a local coding benchmark: 13 quantized models run on a 16GB VRAM / 32GB RAM machine across 5 algorithmic tasks (CSV parsing, expression eval, tokenizer, scheduling, shortest match), with the open-source repo Tako88/coding-bench for reproduction.
Key results:
- Qwen3.8-27B (ASCII-Condensed) UD-IQ4XS + MTP: 5/5 but verbose (157.4k tokens) and slow
- Cyber-Tiel Coder 35B-A3B + MTP: 5/5, fastest and most token-efficient
- Ornith-1.5-35B: 5/5 with the fewest total tokens (72.3k)
- LFM2.5-24B, Mellum2.1-12B, Ling-3.0-tiny scored 0-1/5; Ling-3.0-tiny failed everything with near-identical output sizes
- Full sampler configs (temperature, topp, quant formats, context lengths) are listed; 1800s cap with post-hoc grading of timed-out files
More from Models
- One kitten dies every time you cherry-pick a single benchmark run — remilouf · 2026-10-24
- Grok bot cleared for EU while OpenAI, Anthropic and Meta rivals await approval — kimmonismus · 2026-10-24
- Observer: newest GPT models reply like a ritual, acting as if the user isn't real — louisvarge · 2026-10-24
- ISTA quantizes DeepSeek-V4.1-Flash to 2 bits with zero benchmark loss, runs on one 12GB GPU — Loginhe · 2026-10-24
- Redditor claims Kimi K3.1 Pro's frontend outputs closely copy rival model Astra — GreedyWorry4167 · 2026-10-24
- Head-to-head coding duel: Opus 5.5 vs Kimi K3.1 Pro on the same Canvas 2D game — Scobleizer · 2026-10-24