Gemma 4 Multilingual Capabilities Questioned
LChoshen · x · 2026-07-13
A post questions whether Gemma 4 is truly a multilingual model. The author argues that a genuine multilingual LLM should share language-agnostic capabilities, like spatial understanding, across different languages, which Gemma 4 fails to do.
The post mentions having LLMs play 2D board games against themselves in different languages. They found that 2D performance varies depending on the language, indicating that the model's capabilities are not entirely language-independent.
More from Models
- Sol61 flunks instruction-following: skips mandated research even when explicitly told — lucasmeijer · 2026-10-26
- Kimi K3.1 Pro tops MathArena open models, closing frontier gap to about 6 months — teortaxesTex · 2026-10-26
- Ruff creator Charlie Marsh: frontier models find infinite bugs in any software — charliermarsh · 2026-10-26
- Dev testing one skill across Opus 5.5 and Sol 6.1 finds instruction following 'all over the map' — lucasmeijer · 2026-10-26
- supermemory unveils learner-1, claiming continual learning for any model — julianweisser · 2026-10-26
- Anthropic says Opus 5.5 cuts cost per task by ~40% vs Opus 5 — taufiqintech · 2026-10-26