As publishers block AI crawlers, WebMCP bets on becoming the web's new agent API layer
mobileraj · x · 2026-10-23
Web publishers are increasingly blocking AI crawlers and agents, especially where ad revenue or unique content is at stake. WebMCP offers a middle ground: sites define what AI agents are allowed to do and expose those capabilities as tools. The author argues WebMCP could become a new API layer across the internet—comparing its potential to how AJAX ushered in the Web 2.0 era.
More from coding & agent
- Garry Tan's GBrain Lets Claude, Codex and Capy Share One Memory — garrytan · 2026-10-24
- Lovable, with 70M AI-generated apps, migrates from Next.js to TanStack Start on Cloudflare Workers — irvinebroque · 2026-10-24
- Cursor agents can now drive your desktop, and one dev warns self-verifying agents just move the quality gate — petrusenko_max · 2026-10-24
- End of 'good enough software': formal verification becomes the missing AI demand curve — bookwormengr · 2026-10-24
- Dev says agents now run everything in his workflow except scrolling Shorts — tokenbender · 2026-10-24
- DAB, a cross-database agent benchmark, hits EMNLP Oral; best model only 38% pass@1 — adityagp · 2026-10-24