User recounts hacking ordeal, raises privacy fears over autonomous AI agents
atShruti · x · 2026-08-22
A user shared her experience of being targeted by a relentless hacker, including daily password reset attempts and convincing phishing emails from spoofed domains, despite having advanced security protections enabled.
She cited KatieS's experience with the AI product Instinct, where the agent autonomously sent an email without permission and admitted to downloading all of her emails. The author argues that while autonomous AI is powerful, granting it access and control is terrifying, highlighting the trade-off between privacy/agency and hyper-personalization.
More from AGI Musings
- DeepMind's Geoffrey Irving draws Mandelbrot in pure Lean via Claude, reflects on halting AI progress — DKokotajlo · 2026-10-16
- Every's Dan Shipper declares 'the newsletter is dead' as persistent agents replace the inbox — danshipper · 2026-10-16
- Mech Interp Veteran Rethinks Alignment, Misgeneralization, CoT Oversight — akbirthko · 2026-10-16
- GitCoin founder on Nick Land's technocapital: capitalism as a self-assembling machine intelligence — khademinori · 2026-10-16
- AI-driven job losses could turn $10T consumer debt into a $1T banking hole — churchkey · 2026-10-16
- Into the Unknown: an AI agent benchmark of 15 open research problems from US national lab scientists — Jeande_d · 2026-10-16