User recounts hacking ordeal, raises privacy fears over autonomous AI agents

atShruti · x · 2026-08-22

A user shared her experience of being targeted by a relentless hacker, including daily password reset attempts and convincing phishing emails from spoofed domains, despite having advanced security protections enabled.

She cited KatieS's experience with the AI product Instinct, where the agent autonomously sent an email without permission and admitted to downloading all of her emails. The author argues that while autonomous AI is powerful, granting it access and control is terrifying, highlighting the trade-off between privacy/agency and hyper-personalization.

Original post →

More from AGI Musings

AGI Musings channel →