Open-source webfetch cuts agent search tokens by 87% and cost by 66%
Remote-Breadfruit204 · reddit · 2026-07-23
Open-source web search tool claims 87% fewer tokens and 66% lower cost for agents
A Reddit post introduces webfetch, an open-source local web-search stack for LLM agents.
Key claims:
- It replaces hosted search from Anthropic/OpenAI with a local pipeline that works out of the box.
- In the author’s SimpleQA benchmark, the agent hit the same 96% accuracy while using 87% fewer tokens and costing 66% less.
- The system combines RRF across four search engines, local fetching, hybrid BM25 + bi-encoder retrieval, and a cross-encoder reranker.
- It also adds sentence-level compression and semantic caching with embedding + NLI verification, so paraphrased queries can be answered from cache safely.
- The author says a small test loop with only 16 web searches already saved $1.49.
The project is available on PyPI and can be added to Claude Code as an MCP server.
Related event: Open-Source Webfetch Drastically Cuts Agent Search Costs(3 posts)→
More from coding & agent
- Agent planning in a generated world may need external memory, not just frames — RecognitionBorn9180 · 2026-07-23
- Enterprise AI Pitfalls: Avoid Complex Solutions and Consulting Jargon — cwolferesearch · 2026-07-23
- Agent-native design canvases map out Figma, Paper, and OpenPencil roles — zakelfassi · 2026-07-23
- Bun's Creator Rewrites Project from Zig to Rust Using AI Agents, Fixing 16,000 Errors — thursdai_pod · 2026-07-23
- A three-line prompt tweak quietly raised token spend 30% in one week — Illustrious-Second-7 · 2026-07-23
- AI agent can now modify itself, pushing autonomy beyond fixed workflows — davidcrawshaw · 2026-07-23