Cloudflare launches Disallow AI Training setting, with Apple, Google and Microsoft honoring it
Cloudflare Blog · rss · 2026-09-15
Cloudflare announced a "Disallow AI Training" setting that lets sites stay indexed for search while refusing AI training by mixed-use crawlers. Only <1% of Cloudflare sites block search bots, but 17% block training — evidence of the forced tradeoff. Cloudflare introduced an "Accountable" designation with four requirements (training opt-out, summary opt-out, URL-level visibility, search unaffected); Apple, Google, and Microsoft meet or have committed to meet them. Non-compliant training crawlers (Amazon, Anthropic, Meta, OpenAI) get blocked without affecting search. Migration starts September 15, with AI-summary content controls planned for early next year.
More from Infra
- Give your coding agent GPUs via the Hugging Face CLI in one link — ben_burtenshaw · 2026-09-15
- Human attacker hits machine-speed exploitation of Marimo RCE, pivots in 8 seconds — ChuckDBrooks · 2026-09-15
- Neoclouds: the ignored AI infrastructure race splitting into four distinct player types — DavidLinthicum · 2026-09-15
- A hands-on loop to learn inference engineering: vLLM in Docker, measuring TTFT and batching — malliktwts · 2026-09-15
- MinIO: Open-Source S3-Compatible Object Store That Kills Egress Fees — thisdudelikesAI · 2026-09-15
- NVIDIA announces GTC Washington, D.C. for Nov 30-Dec 3, 2026, with Jensen Huang keynote — nvidia · 2026-09-15