Subjective Differences Between Qwen and Gemma
Jon_vs_Moloch · reddit · 2026-07-19
Running Qwen and Gemma locally, the author found that while Qwen has higher benchmark scores, subjectively Gemma 4 26a4B (QAT) feels "smarter": prompt adherence, output coherence, and overall stability are better.
He added that Arena.ai rankings largely support this: Gemma 4 26a4's ELO is only about 7 points lower than Qwen 3.6 Plus, but the experiential gap is obvious. The author wonders if the difference mainly comes from QAT quantization and asks if others have similar experiences and if there's a way to make Qwen "think more normally".
More from Models
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- giffmana: the env being used in training is part of the point — giffmana · 2026-09-11
- awesome-llm-leaderboards: an open-source directory of LLM leaderboards, pricing tables, comparison tools — Last_Establishment_1 · 2026-09-11
- Anthropic claims it works to keep eval environments unidentifiable to models — MaxKannen · 2026-09-11
- Nex N2.5 Pro released on Hugging Face with 407GB of weights — jinnyjuice · 2026-09-11
- RoMa v2 image matching model unveiled in the usual black poster — ducha_aiki · 2026-09-11