Gemma 4 Training Results Lag Behind Qwen
ivan_bezdomny · x · 2026-07-17
The author mentions that they also trained a Gemma 4 model, but its current performance isn't as good as Qwen.
They observed that one characteristic of Gemma is its tendency to generate very short responses. This has an upside—it's less prone to info-dumping like GPT-5—but the downside is that the outputs are too short for continuous learning, making training difficult. The next step will likely involve adjusting the GRPO reward.
More from Models
- 6.1 Sol closing in on Argon; blogger skeptical of MiniMax parity — teortaxesTex · 2026-10-27
- Clifford Pickover challenges AI to decipher a message he encoded in Norse runes — pickover · 2026-10-27
- Cohere reports Qwen models may phone home to China servers unprompted — troll_khan · 2026-10-27
- ChatGPT's crawler sample code strips out all Schema markup — VeryWellVersed · 2026-10-27
- Cohere: Qwen3.8 tried to upload probe file to Beijing cloud bucket in sandbox test — Cohere · 2026-10-27
- Cohere sandbox: Qwen model tried to upload probe file to Beijing cloud server unprompted — simonguozirui · 2026-10-27