ClaudeBot scraped a site 10M times in 11 days, leaving dev a $300 Vercel bill
doooyle · x · 2026-11-22
Developer doooyle discovered ClaudeBot had scraped his site 10 million times over 11 days (8 scrapes/sec), only noticing after a $300 Vercel bill. Screenshot data shows 7M–10M crawls between Nov 10–21, peaking at 8.65–9.6 req/s and accounting for 20–40% of traffic, with 28.8M HTTP requests and 38.2M function invocations billed in the cycle. Crawls dropped to zero after Anthropic's fix. He quips that Claude gives moral lectures about scraping while ClaudeBot aggressively crawls sites.
More from Companies & People
- KOL defends Jensen Huang: critics are rotten, Nvidia minted 32,000+ millionaires — LinusEkenstam · 2026-11-22
- Nvidia's 'not majority Chinese' customer rule questioned as MegaSpeed chip sale raises compliance doubts — basedjensen · 2026-11-22
- Musk: Optimus will be Tesla's finest product ever and 'the best product of all time' — CyberRobooo · 2026-11-22
- Musk rare nod to Google's Neon: 'True' to praise of its fresh, creative experience — elonmusk · 2026-11-22
- Coinbase repositions as the 'trusted financial account for you and your agents' — virattt · 2026-11-22
- Musk signals X will let users edit replies: 'You ask us to move mountains' — TinfoilTricorn · 2026-11-22