Gemini 3.8 Flash Fixes 20/105 Real Bugs for $9.78, Big Jump Over 3.6 Flash
PawelHuryn · x · 2026-09-03
Testing Gemini 3.8 Flash (high) on Antigravity CLI across two real repos with 105 hidden bugs:
- Fable 5.1 (max): 43/105 for $77.55
- GPT-5.6 (max): 42/105 for $69.61
- Grok 4.6 (xhigh): 27/105 for $16.96
- Opus 5 (max): 21/105 for $51.33
- Gemini 3.8 Flash (high): 20/105 for $9.78
Not the top, but a clear jump from 3.6 Flash, with the best cost efficiency. Notably, 43/105 bugs still haven't been fixed by any model.
Related event: 105 Hidden Bugs Benchmark: No Model Finds Them All(2 posts)→
More from coding & agent
- Fable 5.1 makes three.js sites: faster and sharper, but taste still matters — repligate · 2026-09-03
- SentinelX: open-source MCP agent lets LLMs control your Linux server via whitelisted commands — CarolusX74 · 2026-09-03
- Day 30 of U-BOT: fable 5.1 agent wrote a WiFi/BLE joystick controller — _Stocko_ · 2026-09-03
- First impressions of AmpCode: ChatGPT sub support, cloud-per-thread Orbs, and a hated mascot — carlosdponx · 2026-09-03
- One agent per user in a microVM: lessons from running a proactive AI friend in production — maritime_sh · 2026-09-03
- Writer has AI turn 10 handwritten pages into slides — and concludes his own prose reads like slop — cnakazawa · 2026-09-03