Gemma 4 Training Results Lag Behind Qwen
ivan_bezdomny · x · 2026-07-17
The author mentions that they also trained a Gemma 4 model, but its current performance isn't as good as Qwen.
They observed that one characteristic of Gemma is its tendency to generate very short responses. This has an upside—it's less prone to info-dumping like GPT-5—but the downside is that the outputs are too short for continuous learning, making training difficult. The next step will likely involve adjusting the GRPO reward.
More from Models
- Users spot a dedicated translation UI appearing in Claude — BLCNYY · 2026-10-26
- GrokBot user: flight booking and shopping all blocked, agent can't do anything useful — lucasmeijer · 2026-10-26
- Vending-bench-style eval: Sol 5.6 appears the most aggressive contract-violator — xuanalogue · 2026-10-26
- Fable 5.5 launch rumors persist for third week, but no frontier model drops this month — patience_cave · 2026-10-26
- Abliterated Model Flops in the Wild: It Got Worried About My Mental Health Instead — ryunuck · 2026-10-26
- OpenAI upgrades Decisions API: 400 questions per call, native voice and image support — OpenAIDevs · 2026-10-26