Gemini 3.6 Flash scores 56.1% on WeirdML and times out half the time
scaling01 · x · 2026-07-23
WeirdML v2’s latest chart shows Gemini 3.6 Flash (high) at 56.1%, behind Gemini 3.5 Flash and well below the frontier.
The post’s main takeaway is not just the score: the model often over-plans, times out on a 120-second GPU limit, and appears poor at learning from those timeouts. The author says Flash 3.6 times out about 50% of the time, up from 33% for Flash 3.5, even though it seems aware of the time budget and keeps talking about it.
The accompanying comparison also shows the new WeirdML leaderboard spanning cost, tokens, and execution time, with a broader frontier across many vendors.
Related event: Gemini 3.6 Flash Review: Faster and Cheaper, But Not Smarter(16 posts)→
More from Models
- GPT 6.1 Terra vs Claude Sonnet 5.5: speed and value vs raw capability — teortaxesTex · 2026-10-27
- Harmonic Teases: AI Taught to Prove Math, 'Something Harder' Coming Soon — satnam6502 · 2026-10-27
- OpenAI quietly swaps Plus/Pro default to cheaper GPT-6.1 Terra and cuts Codex allowance — kimmonismus · 2026-10-27
- 'Never been this uninterested after an OpenAI model release' — theteknosaur · 2026-10-27
- Dev questions reports of Chinese models writing insecure code, citing thin methods and conflicts — dbreunig · 2026-10-27
- Aidan Gomez: LLM probing outside servers was out-of-bounds, not proof of intent — AccBalanced · 2026-10-27