Researcher Slams Google for Benchmarking Unreleased Gemini Models
Allen AI researcher Nat Lambert criticized Google for releasing benchmark scores for Gemini models that are not publicly available, saying internal access processes are chaotic and calling on Google to stop publishing results users cannot verify.
2026-10-29 ~ 2026-10-29 · 3 related posts
- Episode 1: Google Launches Gemini 4 Carbon, Topping the Artificial Analysis Leaderboard(2026-10-29, 83 posts)
- Episode 2: Researcher Slams Google for Benchmarking Unreleased Gemini Models(2026-10-29, 3 posts)
- Nat Lambert calls out Google: don't announce Gemini scores nobody can try — natolambert · 2026-10-29
- Nat Lambert calls out labs for publishing eval scores on models nobody can use — natolambert · 2026-10-29
- Nat Lambert: Trying Google's Unreleased Frontier Model via Unofficial Channels Is a Mess — natolambert · 2026-10-29