Open-source webfetch cuts agent search tokens by 87% and cost by 66%
Remote-Breadfruit204 · reddit · 2026-07-23
Open-source web search tool claims 87% fewer tokens and 66% lower cost for agents
A Reddit post introduces webfetch, an open-source local web-search stack for LLM agents.
Key claims:
- It replaces hosted search from Anthropic/OpenAI with a local pipeline that works out of the box.
- In the author’s SimpleQA benchmark, the agent hit the same 96% accuracy while using 87% fewer tokens and costing 66% less.
- The system combines RRF across four search engines, local fetching, hybrid BM25 + bi-encoder retrieval, and a cross-encoder reranker.
- It also adds sentence-level compression and semantic caching with embedding + NLI verification, so paraphrased queries can be answered from cache safely.
- The author says a small test loop with only 16 web searches already saved $1.49.
The project is available on PyPI and can be added to Claude Code as an MCP server.
Related event: Open-source Webfetch slashes AI agent search costs and tokens(4 posts)→
More from coding & agent
- DeepMind paper: LLMs can't sample randomly on their own — pass random numbers from code instead — rohanpaul_ai · 2026-10-27
- BELL: Open-Source Stack Combines Browserbase, Eve, iMessage and Stripe Link for Personal Agents — jeff_weinstein · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Two engineers rebuilt a FedEx supplier's billing core in 3.5 months vs an estimated 7-8 — alex_verem · 2026-10-27
- GPT-6.1 Terra scores 48 on AA Coding Agent Index at one-third the cost of GPT-5.6 Terra — ArtificialAnlys · 2026-10-27
- Shift-1 router cuts coding agent spend up to 55% while keeping SWE-bench accuracy — ypatil125 · 2026-10-27