Local web search tool says it cuts token use 87% and cost 66%
Remote-Breadfruit204 · reddit · 2026-07-23
A local web search stack claims 87% fewer tokens and 66% lower cost
The author built webfetch as an alternative to hosted search from Anthropic and OpenAI, arguing that the default model is expensive: $10 per 1k searches plus roughly 17k result tokens per query.
Key pieces of the system:
- RRF across 4 search engines, local page fetching, BM25 + bi-encoder retrieval, and a cross-encoder reranker
- Sentence-level compression that halves result tokens without measured recall loss
- Semantic caching with embedding match + NLI verification and adaptive TTLs
- Provenance shown for cached results, with the model able to force a fresh search
On its SimpleQA benchmark, the author says the same agent loop matched hosted search at 96% accuracy while using 87% fewer tokens and costing 66% less. One test loop of 16 searches reportedly saved $1.50. It ships as a PyPI install and can be added to Claude Code as an MCP server.
Related event: Local Webfetch Plugin Drastically Reduces Agent Search Costs(2 posts)→
More from coding & agent
- Relay adds open-source multi-model routing for coding: plan, execute, review — MatthewBerman · 2026-07-23
- ASC CLI now covers the full App Store publishing flow, Game Center included — rudrank · 2026-07-23
- Gemini 3.6 Flash Becomes the Default Model for Managed Agents — _philschmid · 2026-07-23
- Lean formalization was mostly Codex-driven and semi-verified by pass@5 — burny_tech · 2026-07-23
- Persistent AI agents need VM snapshots, not just memory — Theta0x33 · 2026-07-23
- Vals-Smith turns your codebase into a custom benchmark to measure which model best resolves your coding tasks — arrakis_ai · 2026-07-23