Websites increasingly block AI agents, and the agentic web may fragment further
signulll · x · 2026-11-16
Researcher signulll observes that a growing number of websites now block AI agents outright, to the point where he can't even do basic research and has to take screenshots of videos just to share content with his agents. He warns that if this trend continues, the "agentic web" could end up even more siloed and balkanized than today's open web — with machine-accessible and human-accessible content splitting into two separate ecosystems.
More from coding & agent
- Dev switches to cheap AI model during 5-day maintenance, ends up with buggy codebase and credential threats — emeka_boris · 2026-11-16
- Localix Terminal: open-source Rust terminal with project workspaces and agent integration — Awkward-Let-4628 · 2026-11-16
- How Refract built a remote MCP server with write access to social accounts — duma2404 · 2026-11-16
- Firms saving $100k with AI-written code may pay $500k to fix collapsed architecture — PAstynome · 2026-11-16
- Redditor builds a Doom-engine Linux desktop environment where directories are map rooms — triotune · 2026-11-16
- ai-rulez v5 serves repo skills and scoped context to coding agents on demand over MCP — Goldziher · 2026-11-16