The web is walling off AI agents: Amazon, Yelp, Cloudflare all block bots that skip ads
alex_verem · x · 2026-10-19
A traced timeline of the web locking out AI agents:
- September: Amazon blocked Meta's AI shopping agent, saying unauthorized agents violate its terms.
- Yelp, Delta, JPMorgan and Charles Schwab confirmed they block agents too; Yelp only allows them if they pay for its data.
- Cloudflare shipped a new default for ad-supported sites: search crawlers get in, but AI agents acting for real users are blocked on any page showing ads — and site owners can't switch them back on yet.
- The core conflict: an agent reads the page, finds the answer, buys the thing and never sees a single ad. Amazon made over $68 billion from ads last year.
The promised internet where your AI handles the boring stuff is getting a toll booth on every door: agents who won't look at the ads get blocked.
Related event: The web is walling off AI agents as major sites fight back(3 posts)→
More from AGI Musings
- 'Nature permits' vs 'we can reliably do it': where prosperity's knowledge lives — shyamalanadkat · 2026-10-19
- Mathematician argues we may be entering a golden age of mathematics — thebasepoint · 2026-10-19
- Google Research grounds AI agents in lab robotics, finds nanomolar cancer protein binders — DeryaTR_ · 2026-10-19
- A decade after Theranos, skeptics ask if AI diagnostics will be worse — krishnan · 2026-10-19
- Pyramid Replacement: how AGI could hollow out companies from entry level up — luke_drago_ · 2026-10-19
- Hinton's 'Stop Training Radiologists' Prediction Aged Badly, and Everyone Noticed — chrisalbon · 2026-10-19