ClaudeBot scraped a site 10M times in 11 days, leaving dev a $300 Vercel bill

doooyle · x · 2026-11-22

Developer doooyle discovered ClaudeBot had scraped his site 10 million times over 11 days (8 scrapes/sec), only noticing after a $300 Vercel bill. Screenshot data shows 7M–10M crawls between Nov 10–21, peaking at 8.65–9.6 req/s and accounting for 20–40% of traffic, with 28.8M HTTP requests and 38.2M function invocations billed in the cycle. Crawls dropped to zero after Anthropic's fix. He quips that Claude gives moral lectures about scraping while ClaudeBot aggressively crawls sites.

Original post →

More from Companies & People

Companies & People channel →