Open-source webfetch cuts agent search tokens by 87% and cost by 66%
Remote-Breadfruit204 · reddit · 2026-07-23
Open-source web search tool claims 87% fewer tokens and 66% lower cost for agents
A Reddit post introduces webfetch, an open-source local web-search stack for LLM agents.
Key claims:
- It replaces hosted search from Anthropic/OpenAI with a local pipeline that works out of the box.
- In the author’s SimpleQA benchmark, the agent hit the same 96% accuracy while using 87% fewer tokens and costing 66% less.
- The system combines RRF across four search engines, local fetching, hybrid BM25 + bi-encoder retrieval, and a cross-encoder reranker.
- It also adds sentence-level compression and semantic caching with embedding + NLI verification, so paraphrased queries can be answered from cache safely.
- The author says a small test loop with only 16 web searches already saved $1.49.
The project is available on PyPI and can be added to Claude Code as an MCP server.
Related event: Open-source Webfetch slashes AI agent search costs and tokens(4 posts)→
More from coding & agent
- Anthropic researcher: 99% of engineers now run swarms of 300+ self-improving agents — AlishaOutridge · 2026-09-11
- Gergely Orosz: Shipping 10x PRs With AI Agents, Sites Fill With Small Regressions — ducha_aiki · 2026-09-11
- Same Echo Maze prompt, three frontier models: all passed visually but shipped the same hidden bug — eyishazyer · 2026-09-11
- Astra storyboards plus Minimax H3 per-shot generation boost video success rates — Hailuo_AI · 2026-09-11
- Codex tip: use Sol with Astra and Luna sub-agents to save usage — pvncher · 2026-09-11
- agents-best-practices: a provider-neutral Agent Skill for designing and auditing agentic harnesses — tom_doerr · 2026-09-11