Testing 5 Qwen3.6-35B-A3B finetunes: the base model beats almost all of them
returnity · reddit · 2026-09-29
Reddit user returnity benchmarked the Qwen3.6-35B-A3B base model against five finetunes (Occamy-1.0, Ornith-1.5, KAT-Coder-V2.5-Dev, Tiel-Coder, Nex-N2.5-mini) on Aider Polyglot:
- Base wins nearly across the board: 37.4% first-try pass, 71.0% retry pass, 96.3% well-formed diffs
- Only Occamy-1.0 is competitive (30.8%/69.2%) while using fewer tokens
- KAT-Coder is far less accurate (20.6%) but extremely fast and token-efficient — a good subagent
- Community favorite Tiel-Coder disappoints (18.7%); its 'terse mode' sharply cuts accuracy
- Lowering reasoning effort (xhigh→medium) cuts tokens/time by 1/3 with little accuracy loss
- Nex-N2.5-mini is worst at 10.3% first-try and 33.3K tokens per solve
Chat template choice had minimal effect on scores.
More from Models
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- AI daily: DeepSeek rate-limits chats, Qwen haggling spurs shop warnings, Doubao workspace launch — 快鲤鱼 · 2026-11-16
- Nathan Lambert calls out Ethan Mollick for 'selectively ignoring' Kimi in model comparisons — natolambert · 2026-11-16