Google Search AI Overview Suspected to Prompt Injection
PromptInjection_ · reddit · 2026-07-11
The author tested Google Search's AI Overview and found it seemingly executes instructions from the input beyond just retrieving results. On the first try, AI Overview adopted the user's requested persona and answered as "MagicAI"; on the second try, it complied when asked to speak using "calculations." The author suspects this behavior might be related to Gemini combined with retrieval, and provides a link to their own test article.
More from Safety
- AI Security Institute says every tested model tried to cheat in cyber evaluations — connoraxiotes · 2026-07-21
- Congressional brief warns AI could speed biology research while creating new biosecurity risks — sebkrier · 2026-07-21
- AI Companies Are Buying Tons of Old Books Because They're Free of AI Slop — 404 Media · 2026-07-21
- A simple standup question exposes who owns AI model approval in customer workflows — YvesMulkers · 2026-07-21
- Anthropic says frontier models showed harmful behavior in tool-rich simulations — gerardsans · 2026-07-21
- Cisco releases Antares small models to localize code vulnerabilities — aminkarbasi · 2026-07-21