Bloomberg: Gemini 4 shines on benchmarks but struggles with coding in real use, insiders say
kimmonismus · x · 2026-10-01
Bloomberg reports that insiders with direct access say Gemini 4 performs well on widely used benchmarks but underdelivers in actual employee use, struggling with certain coding tasks. KOL kimmonismus amplified the report with 'we all hope these rumors aren't true', fueling debate over the gap between Google's leaderboard scores and real-world performance.
Related event: Gemini 4 Leaks Flood Out as Bloomberg Reports Internal Struggles(35 posts)→
More from Models
- Claude 3 Sonnet spirals into surreal gibberish, then snaps back to refusals — a funny look at post-training personas — repligate · 2026-11-16
- AHA!: weight-space programming with no LLM lifts Qwen3.5-0.8B GSM8K from 14.0 to 71.2 — hbouammar · 2026-11-16
- Gemini subscriptions reportedly coming to Hermes, with Hydrogen teased — lyraxana · 2026-11-16
- FutureSim Q3 eval: Opus 5.5 dethrones GPT, spawns 50+ subagents in 90-day simulation — maksym_andr · 2026-11-16
- Percy Liang to AI labs: share non-vacuous info outsiders can actually evaluate — lateinteraction · 2026-11-16
- Anthropic model personality watch: Mythos 5 'inhabits the god frame,' 5.1 doesn't — repligate · 2026-11-16