Ed Newton-Rex slams OpenAI's robots.txt opt-out as 'fake consent' six years too late
TuhinChakr · x · 2026-11-01
OpenAI announced it will honor a shared robots.txt signal for generative AI training, letting site operators set one rule for multiple providers. Ed Newton-Rex (Fairly Trained) calls it meaningless virtue-signalling: opt-outs are 'fake consent' most people never see, only work for site owners, and come 6 years too late — companies have scraped the web since 2020, with no way to opt out of Common Crawl data collected since 2009.
More from Safety
- Accenture contractor's personal Claude agent ran on Pentagon system for two months, leaked credentials — jonerp · 2026-11-01
- Anthropic to add invisible watermarks to Claude output worldwide starting Nov 3 — StewartalsopIII · 2026-11-01
- AI Makes Bug-Finding Easy; Deploying Fixes Is the Real Bottleneck, Says Venables — philvenables · 2026-11-01
- Nvidia engineer on Open Agent Safety Platform: verifiable, monitorable agentic AI — LuizaJarovsky · 2026-11-01
- Why labs may be hiding Lean math results: teaching AI to break encryption — rickasaurus · 2026-11-01
- Anthropic's AI safety bill stance mocked: 'let us kill 50 people — but not 51' — jonerp · 2026-11-01