Claude Blocks Normal Websites Without Server Requests, Devs Lose Traffic
StereotypicalAussie · reddit · 2026-08-10
A WordPress e-commerce site owner found that Claude suddenly failed to fetch their site, returning a ROBOTSDISALLOWED error, while ChatGPT and Googlebot accessed it perfectly.
Server logs revealed no requests from any Anthropic fetcher, suggesting a stale cached robots.txt decision or a false-positive domain blocklist on Anthropic's side. This invisibility causes potential customer loss, yet effective support tickets are hard to get as a paying customer.
More from Models
- unsloth Releases GGUF Quantized Version of Muse Glimmer 30B with Setup Guide — Nunki08 · 2026-08-10
- Meta to Open Source Muse Glimmer 30B and Muse Spark 1.2 — insumanth · 2026-08-10
- ByteDance Open-Sources Muse Glimmer: A 30B Model Running on a Single Consumer GPU — MaziyarPanahi · 2026-08-10
- Testing Meta's Muse Glimmer: Getting the 30B Model to Quantize Itself — ben_burtenshaw · 2026-08-10
- Meta Releases Muse Glimmer: A 30B Open-Weight Model for Local Agents — AIatMeta · 2026-08-10
- Meta Returns to Open Source: Leaked 30B Parameter Model Muse Glimmer — iScienceLuvr · 2026-08-10