Indie dev ships hosted scraping MCP: pay nothing when sites block you, 1000 free credits
SidMishraDev · reddit · 2026-10-13
An indie developer in India released MeshArc, a hosted web-scraping MCP server for AI agents. The pain point: Claude's fetch often hits 403s or Cloudflare walls, and most scraping APIs still charge for failed requests.
How it works: it tries a plain fetch first and only escalates to a session or real Chrome when the site pushes back; if the page still can't be retrieved, you aren't charged. It also crawls whole sites from the sitemap and reports what changed since the last run—the author mainly uses it to watch pricing and docs pages.
Setup is simple: add https://mcp.mesharc.dev/mcp as a connector and log in; works with Claude, Claude Code, and Cursor. Free tier is 1000 credits. The dev is asking users to test it on sites that give them trouble.
More from coding & agent
- CoreWeave Demos Agent Lens to Catch the 1% of Agent Conversations That Go Wrong — altryne · 2026-10-13
- Gamma 5 agent chat leaks raw internal XML path during launch week — Mental-Tennis-6313 · 2026-10-13
- Theo benchmarks Opus 5.5, GPT-6.1 Sol and Muse Wonder Full on a bug fix — shadcn · 2026-10-13
- AI harnesses explained in 6 terms: agent loop, tool calling, context, checkpoints, sandboxing, guardrails — femke_plantinga · 2026-10-13
- Replace .md specs with a state machine: step through your agent's real reducer to interrogate its design — DavidKPiano · 2026-10-13
- Unit42 uncovers C2Agent: LLM-operated Windows malware abusing victims' own AI tools — cyb3rops · 2026-10-13