A False Sense of Privacy: Azure PII tool fails to protect 74% of MedQA data

niloofar_mire · x · 2026-09-09

Citing the paper 'A False Sense of Privacy' (arXiv:2504.21035), the author shows that PII removal and synthetic data generation don't guarantee privacy: innocuous auxiliary info like routine social activities can re-identify sensitive attributes (age, substance use history) from sanitized text. Azure's commercial PII tool fails to protect 74% of information in MedQA; differential privacy helps but hurts downstream utility. Synthetic data carries re-identification risks too.

Related event: Study Finds Azure PII Tool Misses 74% of MedQA Data, Calling De-identification a False Sense of Privacy(3 posts)→

Original post →

More from Safety

Safety channel →