Cloudflare launches Disallow AI Training setting, with Apple, Google and Microsoft honoring it
Cloudflare Blog · rss · 2026-09-15
Cloudflare announced a "Disallow AI Training" setting that lets sites stay indexed for search while refusing AI training by mixed-use crawlers. Only <1% of Cloudflare sites block search bots, but 17% block training — evidence of the forced tradeoff. Cloudflare introduced an "Accountable" designation with four requirements (training opt-out, summary opt-out, URL-level visibility, search unaffected); Apple, Google, and Microsoft meet or have committed to meet them. Non-compliant training crawlers (Amazon, Anthropic, Meta, OpenAI) get blocked without affecting search. Migration starts September 15, with AI-summary content controls planned for early next year.
More from Infra
- To dethrone Postgres, new databases must prioritize ecosystem integrations from day one — mgill25 · 2026-11-02
- ESP32-powered 4-inch touchscreen builds a TUI dashboard for monitoring a DGX inference cluster — CATLLM · 2026-11-02
- OpenRouter crosses 10 quadrillion annualized token run rate, doubling every 10.5 weeks — deedydas · 2026-11-02
- Palmer Luckey asks: can you use datacenter RAM for things prohibited by the operator's terms of service? — avaitopiper · 2026-11-02
- Disable MTP for 20-30% faster local LLM inference on limited RAM — InternalMode8159 · 2026-11-02
- Kioxia up 216% in a year but down 68% from its June 2026 peak — zephyr_z9 · 2026-11-02