Google is called out for weak Gemma models and its stance on open-source LLMs
BoogerheadCult · reddit · 2026-07-25
Google, open source, and Gemma criticism
The poster argues that Google is not a real champion of open source and notes that the company did not sign the anti-open-source-model coalition.
Main claims
- Google’s Gemma models are described as weak across quantization settings and model sizes.
- The poster says none of their tests passed and that even the top 31B model scored poorly in long-running refactoring and debugging tasks.
- Their evaluations used Opus 4.8 as the scorer.
- The argument is that Google released Gemma because it feels pressure from companies seeking on-premise-only LLMs, not out of charity.
Takeaway
This is a highly opinionated but clearly model-centric discussion about Google’s open-source posture and Gemma’s practical quality.
More from Models
- Release blog teaser shows a near-tie on FrontierCode agentic coding benchmark — hardmaru · 2026-07-25
- User Accuses Anthropic of Gaming ARC-AGI-3 by Training Specifically on Benchmark Patterns — VraserX · 2026-07-25
- Moonshot’s open-weight Kimi K3 is nearing top U.S. models and shifting AI economics — OmarUFlorez · 2026-07-25
- Opus 5 tops nine biology benchmarks, but still trails in some analysis tasks — kenbwork · 2026-07-25
- Claude Opus 5 now allows source-code vulnerability discovery but still blocks binaries — TheZvi · 2026-07-25
- Thread argues scaled RL and large distillation favor Anthropic in the current race — rickasaurus · 2026-07-25