Artificial Analysis benchmarks 27 Search APIs across 14 providers; DeepSeek Search 3 points off the lead
ArtificialAnlys · x · 2026-10-22
Artificial Analysis launched a Search API benchmark and leaderboard covering 27 products from 14 providers, measuring how well AI agents retrieve grounded, up-to-date web information. Scoring uses an equal-weighted mean of DeepSearchQA (F1), BrowseComp (exact-answer accuracy), and AA-Omniscience, alongside cost-per-task and time-per-task metrics.
- DeepSeek Search: strongest on factual questions, weakest on multi-hop browsing — 70% on AA-Omniscience (3 points behind the leaders), 75 F1 on DeepSearchQA, 63% on BrowseComp.
- All Search API rows run on Stirrup, their open-source agent harness, with a model-only baseline for comparison.
- Latest data: Oct 19, 2026; providers can request inclusion.
Methodology and leaderboard are public, helping developers weigh cost, speed, and retrieval quality when picking a search tool.
More from Models
- Users complain Anthropic models have 'suddenly got really stupid' — gaganghotra_ · 2026-10-22
- The '4' in Gemini 4 was a randomly chosen number, insider says — prajdabre · 2026-10-22
- DeepSeek Search debuts at $0.75/1k searches, cheapest paid Search API, ranks 17th of 27 — ArtificialAnlys · 2026-10-22
- Lafa scales flow language models to 8B, matching AR quality at 2.5x throughput — AdtRaghunathan · 2026-10-22
- Jev 1.14 lands on Databricks, targeting fast decisions and complex tasks — matei_zaharia · 2026-10-22
- Reddit asks: which 50-150B MoE models are worth running locally besides Qwen Flash Next — FlyingFishMakeAWish · 2026-10-22