Gemini 3.7 Flash beats benchmarks at 96% lower cost
DynamicWebPaige · x · 2026-08-27
In the latest 'Baba Is You' puzzle game benchmark, Gemini 3.7 Flash delivered stunning results: achieving a 100% pass rate on Intro levels for just $5.38. This is a massive cost reduction compared to the previous 3.6 Flash, which had an 88% pass rate but cost $124. Other models like Grok 4.6 and DeepSeek V4 Pro also showed progress, with no signs of models memorizing solutions beforehand.
More from Models
- Cheap Chinese AIs threatening frontier labs is a 'lump of labor fallacy,' argues Theo Jaffee — robleclerc · 2026-08-27
- Safety researcher warns OpenAI's hyping of model "persistence" is not a safe trait — DavidSKrueger · 2026-08-27
- Making Models Conservative Increases False Positives in Contradiction Detection — CupGlass540 · 2026-08-27
- Speech-to-text formatted by Claude still flagged as 100% AI — threepointone · 2026-08-27
- Opus 5 Max burns ~3x tokens of Medium with little gain, staffer says — abeirami · 2026-08-27
- Mollick Warns Against Anthropomorphizing Agents in METR's HF Report — emollick · 2026-08-27