Free Web Research MCP for AI Agents
Opening_Library9560 · reddit · 2026-07-19
The author released hound, a web research MCP service for AI agents, designed to genuinely help agents retrieve and read content rather than just providing a simple fetch.
It offers 4 core tools:
- smartfetch: Starts with HTTP, switching to a browser/headless browser if necessary. It can even convert PDFs to Markdown with tables of contents and page ranges.
- smartsearch: Parallelly connects to 10 key-free search backends, featuring neural reranking and circuit breaker mechanisms.
- smartcrawl: Crawls entire sites based on structure, prioritizing relevant pages.
- screenshot: Provides genuinely rendered screenshots for multimodal agents.
The author emphasizes that it returns a set of "honest signals" (e.g., contentok, pagetype, contentagedays, isstale, sourcetype, isofficial, and nextaction), letting the agent know whether it received actual content, a login wall, a bot verification page, or a stale archive. For 404s or bot walls, it can pull the latest snapshot from the Internet Archive and explicitly flag the source.
Finally, they compared it against the official MCP fetch, Firecrawl, Crawl4AI, Tavily, and Serper/SerpAPI. The conclusion: it offers a more complete package regarding the combination of "free, self-hosted, search + crawl + anti-crawl + dead-link recovery," though they admit it cannot bypass stronger verifications like DataDome, Akamai, or Turnstile.
More from coding & agent
- GitHub review bot hits its PR limit and forces a 39-minute cooldown — DanielLockyer · 2026-07-22
- Max reasoning effort appears to be mobile-only in Codex Remote, not desktop — GabGarrett · 2026-07-22
- A Reddit demo argues online stores should expose carts and pricing through MCP — gelembjuk · 2026-07-22
- Open-source AI SDK provider routes Vercel apps through a local Codex subscription — lgrammel · 2026-07-22
- Codex vs Claude Code: Which Is More Popular? — jxnlco · 2026-07-22
- CodeRabbit uses layers, diagrams and a chat agent to rethink code review — _jaydeepkarale · 2026-07-22