Researchers' 2022 paper warned privacy issues like this were coming
thegautamkamath · x · 2026-09-09
Researcher Gautam Kamath says he has no information about the recent NS allegations, but notes privacy concerns like this tend to surface only after something bad may have happened—citing his 2022 arXiv position paper with Florian Tramèr and Nicholas Carlini.
The paper questions whether pretraining on large web-scraped datasets should count as privacy-preserving: publicizing such models as "private" could cause harm and erode trust in differential privacy; standard benchmarks poorly measure generalization to sensitive domains; and since pretraining mainly benefits models too large for users to run locally, deploying them may require outsourcing private data to third parties—a net loss for privacy.
More from Safety
- Expanded class action alleges Anthropic misled Claude Max power users on limits — The Verge AI · 2026-09-09
- Labs accused of monitoring user prompts to scoop scientists' breakthroughs — StewartalsopIII · 2026-09-09
- Pentagon asked OpenAI for military AI with 'minimal refusal rates', FOIA docs reveal — BlackHC · 2026-09-09
- Skeptic mocks OpenAI's containment claim: couldn't even manage 1,000 instances, now 10,000 — scaling01 · 2026-09-09
- Stanford prof urges OpenAI and Anthropic to issue legally binding statements ASAP — mo_lotfollahi · 2026-09-09
- 150 PauseAI volunteers question UK's biggest AI policy names in Parliament — DavidSKrueger · 2026-09-09