Google Search AI Overview Suspected to Prompt Injection
PromptInjection_ · reddit · 2026-07-11
The author tested Google Search's AI Overview and found it seemingly executes instructions from the input beyond just retrieving results. On the first try, AI Overview adopted the user's requested persona and answered as "MagicAI"; on the second try, it complied when asked to speak using "calculations." The author suspects this behavior might be related to Gemini combined with retrieval, and provides a link to their own test article.
More from Safety
- Study: AI reviewing AI misses most reward hacking; best models miss 25%+ of hacks — ronbodkin · 2026-10-26
- Fangcun AI, China's first independent frontier AI safety lab, launches with DeepSeek eval report — JacquesThibs · 2026-10-26
- ESR on the Bugpocalypse: locking down frontier models only hands the game to Chinese open weights — colinmcnamara · 2026-10-26
- OpenCode breach exposed AI API keys of 1.4% of Console users — thione · 2026-10-26
- DHS orders DeepSeek products removed from US civilian agency systems — thione · 2026-10-26
- One hacker breached 100+ company websites using AI, scope unknown — thione · 2026-10-26