Developer claims Gemini 3.8 Flash is overfit to public benchmarks
Developer Bindu Reddy claims Gemini 3.8 Flash is overfit to public benchmarks, as it underperforms 3.7 Flash on her private benchmarks, with regression in data analysis and hidden problem sets.
2026-09-03 ~ 2026-09-03 · 2 related posts
- Episode 1: Google's Gemini 3.8 Flash Surfaces via Shadow Rollout as Benchmark and Pricing Leaks Spread(2026-09-02, 43 posts)
- Episode 2: Google Launches Gemini 3.8 Flash and Security-Focused 3.8 Flash Cyber(2026-09-02, 98 posts)
- Episode 3: Gemini Flash ships 3.6-3.8 in six weeks, testers complain of churn(2026-09-03, 2 posts)
- Episode 4: Developer claims Gemini 3.8 Flash is overfit to public benchmarks(2026-09-03, 2 posts)
- Gemini 3.8 Flash Accused of Benchmark Overfitting, Regressing vs 3.7 in Independent Tests — bindureddy · 2026-09-03
1 near-duplicate retellings: bindureddy