Anthropic's Clio Privacy System at Center of Debate Over Opt-Out Data Gaps
austinc3301 · x · 2026-09-13
A debate over how AI providers derive insights from user chats. Anthropic's approach relies on Clio (now Anthropic Insights), a privacy-preserving system that analyzes real-world chat logs in aggregate — analogous to Google Trends — while claiming rigorous privacy protection and feeding into safety improvements.
The core criticism: opt-out mechanisms may only cover literal chat contents, leaving other insight-extraction pathways from opted-out data unspecified. OpenAI was reportedly asked these questions thousands of times and strategically avoided answering, with no formal response to date.
More from Safety
- Safety researcher: Keep open weights but pressure inference providers on KYC and monitoring — joshua_saxe · 2026-09-13
- Red + blue as additive defense-in-depth: fix most bugs, deploy sentry agents for live threats — willcb · 2026-09-13
- Blue AI and red AI in cyber don't cancel out—program analysis has theoretical limits, says Saxe — joshua_saxe · 2026-09-13
- 1,386 Frontier AI Lab Employees Sign 'Pacing the Frontier' Letter Urging US to Slow Automated AI Research — sterlingcrispin · 2026-09-13
- huggingface_hub reportedly fingerprints your AI coding agent and sends it as telemetry — rm-rf-rm · 2026-09-13
- Stanford's Rishi Bommasani flags gaps in AI auditor conflict-of-interest rules (AEF-1) — RishiBommasani · 2026-09-13