Cloudflare blocks AI crawlers by default, letting publishers refuse training bots and agents

emmanuelvivier · x · 2026-09-15

Cloudflare now blocks AI crawlers by default: publishers can refuse AI training bots and AI agents on their pages. (Context from the thread: NSA, FBI and CISA accuse DeepSeek, Moonshot and four other Chinese labs of industrial-scale distillation.)

Related event: Cloudflare Blocks AI Crawlers by Default; Perplexity Ships Local Windows Agent(2 posts)→

Original post →

More from Safety

Safety channel →