Subjective Differences Between Qwen and Gemma
Jon_vs_Moloch · reddit · 2026-07-19
Running Qwen and Gemma locally, the author found that while Qwen has higher benchmark scores, subjectively Gemma 4 26a4B (QAT) feels "smarter": prompt adherence, output coherence, and overall stability are better.
He added that Arena.ai rankings largely support this: Gemma 4 26a4's ELO is only about 7 points lower than Qwen 3.6 Plus, but the experiential gap is obvious. The author wonders if the difference mainly comes from QAT quantization and asks if others have similar experiences and if there's a way to make Qwen "think more normally".
More from Models
- Kimi K3.1 Pro tops MathArena open models, closing frontier gap to about 6 months — teortaxesTex · 2026-10-26
- Ruff creator Charlie Marsh: frontier models find infinite bugs in any software — charliermarsh · 2026-10-26
- Dev testing one skill across Opus 5.5 and Sol 6.1 finds instruction following 'all over the map' — lucasmeijer · 2026-10-26
- supermemory unveils learner-1, claiming continual learning for any model — julianweisser · 2026-10-26
- Anthropic says Opus 5.5 cuts cost per task by ~40% vs Opus 5 — taufiqintech · 2026-10-26
- AI search APIs ranked: top 12 within 7 points, yet prices differ nearly 7x — FinanceYF5 · 2026-10-26