How AA Benchmarks 26 Search API Products Across 13 Providers
ArtificialAnlys · x · 2026-10-06
Artificial Analysis shared links for its search evaluation: the leaderboard, methodology page (including how OpenAI Web Search is run), and Strup, the open-source agent harness used for all Search API rows. Search API providers can request inclusion.
The benchmark covers 26 Search API products across 13 providers, evaluating underlying web indexes, result presentation, and cost/speed/quality tradeoffs for agentic use cases like deep research and coding. Scores are the equal-weighted mean of DeepSearchQA, BrowseComp and AA-Omniscience (0–100), all with the same candidate answer model. Data as of Sep 28, 2026.
Related event: OpenAI Web Search Debuts at No.5 in Search Benchmark, ~$0.05 per Task(4 posts)→
More from Models
- Grok web app to add Team Bots: one shared bot, private chats for each member — nima_owji · 2026-10-06
- Liquid AI's d1 hits 85-97% on VisA inspection tasks with zero task-specific training — JosephJacks_ · 2026-10-06
- QuantCode: domain pretraining + SFT lifts Qwen trading-code pass from 27.8% to 58.2% — Alexey Chernysh · 2026-10-06
- GLM-5.3 appears context-aware, reportedly saying it's running low on context — khademinori · 2026-10-06
- Azure catalog briefly leaks unreleased OpenAI model GPT-6.1-Sol, page pulled within an hour — _AndrewZhao · 2026-10-06
- Opus 5.5 is efficient on subscription, not via API — 6.1 remains the workhorse — haider1 · 2026-10-06