Developer Says Anthropic's Claudebot Hits His Site 280K+ Times Per Day
TejasKumar_ · x · 2026-10-02
Developer Tejas Kumar reports that Claudebot, Anthropic's web crawler, hits his website over 280,000 times per day, asking why the volume is so high. The post highlights ongoing community friction over AI crawlers' aggressive scraping and site load.
More from Models
- Google's real moat is compute infrastructure, not just Gemini benchmark scores — haider1 · 2026-10-02
- giffmana: current models are great at precision but really bad at recall — giffmana · 2026-10-02
- After a week of testing, user finds Claude overly rigid vs ChatGPT — Redstra · 2026-10-02
- A 3-step guide to open models: picking, hosting locally or via OpenRouter — every · 2026-10-02
- Zero-shot classifiers rebranded as 'decision models' surprises HF engineer — mervenoyann · 2026-10-02
- Dev releases low-bit Qwen3.8-Flash quant keeping 95% bf16 accuracy at long contexts — Crampappydime · 2026-10-02