AI Agents Blocked by Anti-Bot Systems on Public Websites, Tests Show

Controlled tests show Claude Code's default web tools were blocked by anti-bot systems on 3 of 5 public sites including Zillow, Indeed and Reddit, but all succeeded after integrating a crawler API.

2026-11-07 ~ 2026-11-07 · 2 related posts

• Test: AI agent blocked on 3 of 5 public sites until routed via scraping API — eyishazyer · 2026-11-07
• AI agents blocked by Zillow, Indeed, Reddit — a scraping API got 3/3 through in testing — eyishazyer · 2026-11-07