Websites are closing their doors to AI agents
evolve2k · hn · 2026-10-18
The Verge reports that a growing number of websites are actively blocking AI agents from accessing their content. The HN thread discusses why sites are shutting out agents, the technical methods used to detect and block them, and what this means for the open web and the agent ecosystem.
More from AGI Musings
- AI influencer poses as grieving woman on TikTok to promote bereavement app, millions of views — omooretweets · 2026-10-19
- Professor's in-class handwritten papers plan sparks debate on teaching with AI — lmoroney · 2026-10-19
- Torvalds, Carmack and Sweeney are all pro-AI, notes dev in fan-tribute thread — draginol · 2026-10-19
- In 1952, people already argued 'instruction' and 'memory' anthropomorphized computers — dmd · 2026-10-19
- Kenneth Stanley questions mechanistic interpretability: why mind-reading but no mind-improving? — kenneth0stanley · 2026-10-19
- NYT opinion: 'This Is the Good Scenario?' on the AI bubble and who controls the aftermath — nytopinion · 2026-10-19