Gemma 4 31B vs Qwen3.8 27B: benchmark leaderboards flatly contradict each other
uncle_leon · reddit · 2026-08-26
A Reddit user picking a model for a hobby project found two leaderboards giving opposite verdicts: Artificial Analysis rates Qwen3.8 27B far ahead, while Arena ranks Gemma 4 31B almost 20 places higher and crushing Qwen in many categories. Community sentiment favors Qwen as more tenacious at reasoning, at the cost of overthinking simple tasks. The thread probes how different evaluation methodologies (speed-weighted intelligence vs blind user preference) produce conflicting rankings.
More from Models
- Grok Voice 3.0 reportedly powers Tesla in-car assistant with millions of daily conversations — XFreeze · 2026-10-15
- Gemini 4 Argon coding style: neat one-line comments, but does the code actually work? — zacharynado · 2026-10-15
- Why ChatGPT beats the better Claude with mainstream users: being first known — aitrendz_xyz · 2026-10-15
- 'You need high pain tolerance to review Gemini 4,' researcher quips amid error screens — gleech · 2026-10-15
- MiniCPM-V 4.7 runs a 35B MoE multimodal model on phones with just 3GB memory — nevrekaraishwa2 · 2026-10-15
- Gemini 4 Argon wrote 5,000+ lines of pure Python to build its own ray-tracing 3D engine — aitrendz_xyz · 2026-10-15