Gemini 3.7 Flash Tops AA-AnalystAgent Benchmark
Google announced that Gemini 3.7 Flash ranks first on Artificial Analysis's newly launched AA-AnalystAgent leaderboard with 60.0% overall accuracy, beating multiple flagship models. According to @melvinjohnsonp, the model offers 2.4x faster reasoning at very low cost, making it both accurate and practical for agent use cases.
Confirmed
- Gemini 3.7 Flash scored 60.0% and ranked first on AA-AnalystAgent (reported consistently by @philschmid, @melvinjohnsonp and several reposts)
- The benchmark, launched by Artificial Analysis, comprises 80 real-world quantitative analysis tasks across 14 domains such as finance, healthcare and government grants, simulating the daily work of business/data analysts
- Models are tested in an isolated sandbox using Python and database libraries to process files
- @melvinjohnsonp noted the model's reasoning is 2.4x faster at very low cost
Why it matters
AA-AnalystAgent measures a model's ability to act as an agent on real data-analysis tasks rather than simple QA. A lightweight model topping the chart in accuracy while being fastest and cheapest highlights the cost-effectiveness of mid-tier models in agentic scenarios, offering strong reference value for real-world deployment.
2026-08-19 ~ 2026-08-21 · 5 related posts
- Episode 1: Google Launches Gemini 3.7 Flash: Big Benchmark Gains at Half the Price(2026-08-13, 89 posts)
- Episode 2: Google Rolls Out Gemini 3.7 Flash Across Apps, Search, Workspace and Copilot Amid Pricing Backlash(2026-08-14, 19 posts)
- Episode 3: Devin adds Gemini 3.7 Flash, matching Claude Sonnet 5 at half the cost(2026-08-14, 3 posts)
- Episode 4: Google Gemini 3.7 Flash Released(2026-08-14, 11 posts)
- Episode 5: Gemini 3.7 Flash Ranks 7th in Benchmark(2026-08-16, 2 posts)
- Episode 6: Gemini 3.5 Pro Not Renamed, Was 3.7 Flash Stealth Test(2026-08-16, 2 posts)
- Episode 7: Gemini 3.7 Flash Wins Praise: Up to 6x Faster in Agent Workflows(2026-08-17, 15 posts)
- Episode 8: Gemini 3.7 Flash Tops AA-AnalystAgent Benchmark(2026-08-19, 5 posts)
- Episode 9: Google launches Gemini 3.7 Flash: faster, half-price promo(2026-08-20, 2 posts)
- Episode 10: Gemini 3.7 Flash Tops ARC-AGI at $0.12 Per Task(2026-08-21, 4 posts)
- Episode 11: Gemini 3.7 Flash Becomes Google's Fastest-Growing Model in First Week(2026-08-22, 2 posts)
- Episode 12: Gemini 3.7 Flash Wins Praise for Blazing Speed and Value(2026-08-22, 4 posts)
- Episode 13: Developers Praise Gemini 3.5 Flash as Google's Competitive Debate Rages(2026-08-23, 3 posts)
- Episode 14: Gemini 3.7 Flash Tops Analyst Agent Benchmark(2026-08-24, 2 posts)
Primary sources
- Gemini 3.7 Flash tops AA-AnalystAgent leaderboard with 2.4x speedup — melvinjohnsonp ·
- Gemini 3.7 Flash Tops AA-AnalystAgent Benchmark — _philschmid ·
- Gemini 3.7 Flash tops new AA-AnalystAgent quantitative analysis benchmark — _philschmid · 2026-08-19
- [source] Gemini 3.7 Flash tops AA-AnalystAgent leaderboard with 2.4x speedup — melvinjohnsonp · 2026-08-20
- Gemini 3.7 Flash tops benchmark, beating flagship frontier models — mtizard · 2026-08-20
- Gemini 3.7 Flash Tops AI Analyst Benchmark with Fastest Speed — vedantmisra · 2026-08-21
1 near-duplicate retellings: _philschmid