Local web search tool says it cuts token use 87% and cost 66%
Remote-Breadfruit204 · reddit · 2026-07-23
A local web search stack claims 87% fewer tokens and 66% lower cost
The author built webfetch as an alternative to hosted search from Anthropic and OpenAI, arguing that the default model is expensive: $10 per 1k searches plus roughly 17k result tokens per query.
Key pieces of the system:
- RRF across 4 search engines, local page fetching, BM25 + bi-encoder retrieval, and a cross-encoder reranker
- Sentence-level compression that halves result tokens without measured recall loss
- Semantic caching with embedding match + NLI verification and adaptive TTLs
- Provenance shown for cached results, with the model able to force a fresh search
On its SimpleQA benchmark, the author says the same agent loop matched hosted search at 96% accuracy while using 87% fewer tokens and costing 66% less. One test loop of 16 searches reportedly saved $1.50. It ships as a PyPI install and can be added to Claude Code as an MCP server.
Related event: Open-source Webfetch slashes AI agent search costs and tokens(4 posts)→
More from coding & agent
- GitHub Copilot team routes user bug reports to an AI agent via Slack — marlene_zw · 2026-09-11
- Scanning 23 agent sessions, a dev found 3 silent failure modes in memory systems — No_Advertising2536 · 2026-09-11
- eslint-plugin-react v8.0.2 adds 4 checks for React 19.3, supports ESLint 10 and Biome — viglovikov · 2026-09-11
- Arkon: open-source MCP server turns enterprise SOPs into a traceable LLM knowledge wiki — tom_doerr · 2026-09-11
- Cheaper OpenAI Agents API alternative: sandbox service undercutting E2B by 46% — airesearch12 · 2026-09-11
- His agent kill switch ran for months before he found it was wired to nothing — AnvilandCode · 2026-09-11