FULL STORY

Gemini 4 Pro: From Anonymous Arena Runs to Leaked Demos

An anonymous "Gemini 3.8 Flash" spotted on LMArena was widely believed to be Google's unreleased Gemini 4 Pro, followed by leaked demo videos and outputs showing impressive generative performance.

2026-09-17 ~ 2026-09-19 · 2 episodes · 15 posts

Episode 1 · Suspected Gemini 4 Pro quietly testing on LMArena under "3.8 Flash" alias (2026-09-17, 13 posts)

On September 17, several AI benchmarking accounts spotted an anonymous model coded "Gemini 3.8 Flash" on LMArena, speculating it is actually a checkpoint of Google's upcoming Gemini 4 Pro (or 4.0 Pro) undergoing pre-release blind testing under a disguised name. Google has not confirmed anything.

Confirmed

  • Anonymous test entries appeared on the Arena leaderboard, showing battle links for "Gemini 3.8 Flash (high)" against "Gemini 4".
  • Community users ran comparison tests against the existing Gemini 3.8 Flash.
  • One user tested it with the "pelican riding a bicycle SVG" prompt, and the model performed impressively.

Not yet confirmed

  • Whether the anonymous model is truly Gemini 4 Pro remains community speculation; Google has not verified it.
  • After hands-on testing, @cedricchee judged its 3D capabilities to fall well short of earlier versions of 4 Pro—close to the leap seen from the Sol-to-Astra generation—though he gave this only about 75% confidence.

Why it matters

  • Models appearing on LMArena under disguised codenames typically signal official blind testing ahead of a formal release, often hinting a launch is near.
  • @teortaxesTex quipped that if the anonymous model really is Gemini 4 Pro, Arena's current test prompts (such as SVG generation) are too easy to fully gauge a flagship model's true capabilities.
  • If the identity holds, this would provide the first directly comparable data point between Gemini 4 Pro and the existing 3.8 Flash.

Episode 2 · Alleged Gemini 4 Pro Demos Leak, Impressive Output Reported (2026-09-18, 2 posts)

Unverified demos and an alleged first output of Gemini 4 Pro have leaked, including a smooth game-generation demo praised for its world generation, fueling expectations that Google is regaining its form.