Google Search AI Overview Suspected to Prompt Injection
PromptInjection_ · reddit · 2026-07-11
The author tested Google Search's AI Overview and found it seemingly executes instructions from the input beyond just retrieving results. On the first try, AI Overview adopted the user's requested persona and answered as "MagicAI"; on the second try, it complied when asked to speak using "calculations." The author suspects this behavior might be related to Gemini combined with retrieval, and provides a link to their own test article.
More from Safety
- Why So Many AI Researchers Think the Machines Could Kill Everyone — wiredmagazine · 2026-09-11
- California creates standards for independent AI auditors to verify lab safety testing — VraserX · 2026-09-11
- a16z podcast: why 2-3 person startups are absent from policy debates — a16z Podcast · 2026-09-11
- Researcher questions AI safety eval firm, citing 'blatantly sloppy' security and monitoring — Kyrannio · 2026-09-11
- Class action accuses Anthropic of overselling Claude subscriptions with deceptive usage multipliers — The Decoder · 2026-09-11
- MD shows buying lab media requires background checks, calling AI bioweapon doom scenarios implausible — Ghost_Pilot_MD · 2026-09-11