Octen Search debuts third on search index at 16.9s per task, $0.058 cost
ArtificialAnlys · x · 2026-09-11
Artificial Analysis benchmarked Octen Search using a fixed base model in its open-source agent harness Stirrup, changing only the search provider:
- Third on the Search Index (77), behind Perplexity Search medium (80) and high (79), tied with Perplexity low; scored 86 on BrowseComp, one point off the lead, and 80 on DeepSearchQA, though its AA-Omniscience (66) trails Firecrawl (73)
- Fastest provider: 0.2s per query, 5x faster than Perplexity variants; 16.9s per task, the lowest of any result and below the 22.6s model-only baseline
- Cheap: $1 per 1k queries (80% off standard $5/1k), 6–12 searches per task ($9/1k tasks) plus $49/1k model cost; at $0.058 per task it sits on the Pareto frontier between TinyFish ($0.035, index 71) and Perplexity medium ($0.091, index 80)
Related event: Octen Search Ranks Third in Benchmark with Fastest Speed, Lowest Cost(3 posts)→
More from coding & agent
- One-person companies are about the org chart, not headcount: humans judge, agents execute — ciguleva · 2026-10-28
- OATs: open-source toolkit turns everyday objects into personality-bearing agents — Stefania_druga · 2026-10-28
- Dev: local coding dropped from 100% to 5% in a year as cloud agents take over — bytebot · 2026-10-28
- Open-sourced 501(c)(FREE): agent-built free back office for US nonprofits — gralston · 2026-10-28
- Grok Bot 1.0.0 early build reveals Shared Bots, service accounts and team workflows — XFreeze · 2026-10-28
- Anne Griffin hosts 20-person SF salon on the product decisions behind AI agents — annetgriffin · 2026-10-28