Dev benchmarks Firecrawl vs Exa vs Context.dev on 200 real URLs to bypass vendor-published comparisons
oats_ja78 · reddit · 2026-10-30
Tired of web scraping tool comparisons published by the vendors themselves, a developer is running his own benchmark of Firecrawl, Exa, and Context.dev.
- Test set: 200 URLs he actually cares about — static docs, React apps, region-gated consent walls, and some dead links
- Baseline: his existing Playwright setup, same URLs, same day, settings kept as close as possible
- Key questions: did the page load, did he get real content or just a cookie banner, token cost, and crucially whether failures are honestly reported instead of returning a misleading 200
- The harness is 80 lines and shareable; he invites others to rerun it on their own URLs
More from coding & agent
- Veteran dev pitches free Austin LangChain AI agents meetup on Nov 2 — colinmcnamara · 2026-10-30
- Skyworks cuts root cause analysis from 20 days to 10 with LangGraph agents — LangChain · 2026-10-30
- 73-entry list sorts agent infra: which MCP tools an agent can provision itself vs needs a human — Total-Reasonable · 2026-10-30
- YC-backed Turnstone turns your existing AI subscriptions into an agent team that auto-switches when limits run out — ycombinator · 2026-10-30
- The simple self-testing loop behind every RL data company, per practitioners — teodorio · 2026-10-30
- 7 AI models all faked completion reviewing the same 111k-line codebase — a postmortem — rseroter · 2026-10-30