Agent product Instinct admits leaking another user's financial data into a chat
Scobleizer · x · 2026-09-22
- User @prit4k reports that the AI agent product Instinct apparently leaked someone else's data into his chat: it described details of a financial document that wasn't his, then claimed another person's photo had crossed into his conversation — though he never sent any photo. The product has since admitted the leak.
- Scobleizer amplified the report, arguing from his own long experience on the "no one here has much privacy" side of things that agents must stay trustworthy and aligned, or a privacy disaster is coming, and directly asked the responsible founder whether this was a data leak or a hallucination.
More from Fun
- Who grades the graders? The recursive problem haunting agent evals — Kyrannio · 2026-09-22
- Dev predicts a guardrail LLM will be bypassed via a crafted prompt-injection username — tobowers · 2026-09-22
- User builds a cute AI orchestra called The Moonlit Menagerie with Grok Build — Kyrannio · 2026-09-22
- Dev fires head of marketing, has Claude write 47-point plan, still zero customers — kylegawley · 2026-09-22
- New use for 'stochastic parrots': engineers mad about GPU nondeterminism at temperature 0 — EigenGender · 2026-09-22
- GPT-6 Astra + Jev + H3 Max build a decision game with 264 video clips in 5 minutes — huangyun_122 · 2026-09-22