The bigger PII risk in LLM apps isn't the provider — it's your logs, traces, and agent memory

abhi1510 · reddit · 2026-10-28

A Reddit discussion thread argues that when sending sensitive data to LLMs, too much focus goes to whether OpenAI or Anthropic can be trusted, while the bigger concern is the rest of the stack: prompts containing names, SSNs, medical or financial data can end up in application logs, observability tools, error traces, conversation histories, agent memory, eval datasets, and downstream API calls. The analogy: developers wouldn't put an API key in a prompt even if they trusted the provider — but you can rotate a key, not someone's SSN. He asks production devs whether they actively mitigate this via redaction, tokenization, anonymization, self-hosting, or contracts, and how it ranks on their engineering priority list.

Original post →

More from Safety

Safety channel →