Firecrawl's FantasyBench: agents hit 80.5% on 272 fantasy football questions, beating web search by 8.8 points
devdigest · x · 2026-10-27
Alongside its $75M Series B announcement, Firecrawl released FantasyBench: 272 real fantasy football questions about the 2026 NFL season, graded against nflverse stats and projections from 7 sites.
Key findings: built-in web search feeds agents wrong numbers, and a few points can flip a start/sit call. Firecrawl's Alexandria setup answers 80.5% of all questions fully correct, 8.8 points ahead of native web search and 9.2 ahead of Flaim. Value accuracy reaches 98.8% (vs 92.6% Flaim, 85.0% web search) with the fastest median response at 47s. Setups are close on past-game stats; the gap comes from weekly projections and injury reports.
More from Venture
- Anthropic S-1 reveals just 250 customers spend over $10M, early investor says market barely started — mmurph · 2026-10-28
- Data brokering is the new dropshipping, warns founder calling out inflated ARR claims — realsohamparekh · 2026-10-28
- India's Preventive Health Startup Cent Raises $15M Series A for AI-Powered Early Screening — adityaag · 2026-10-28
- Y Combinator RFS: 19,000 US Cities Make City Hall One of AI's Biggest Untapped Markets — ycombinator · 2026-10-28
- Y Combinator RFS Calls for LLMs Built Specifically to Write Well as RLHF Flattens Prose — ycombinator · 2026-10-28
- Y Combinator RFS: Air-Gapped Industries Need Frontier AI Brought Inside the Walls — ycombinator · 2026-10-28