Google Search AI Overview Suspected to Prompt Injection
PromptInjection_ · reddit · 2026-07-11
The author tested Google Search's AI Overview and found it seemingly executes instructions from the input beyond just retrieving results. On the first try, AI Overview adopted the user's requested persona and answered as "MagicAI"; on the second try, it complied when asked to speak using "calculations." The author suspects this behavior might be related to Gemini combined with retrieval, and provides a link to their own test article.
More from Safety
- Exponential launches RepoInject and BrowserInject benchmarks for prompt injection robustness — maksym_andr · 2026-10-27
- Poster surprised that v4.1 flash gets more accurate when asked to control its CoT — dfrsrchtwts · 2026-10-27
- Redwood: CoT controllability evals are under-elicited; better prompts boost scores 2-3x — dfrsrchtwts · 2026-10-27
- Dev claims Anthropic is baking 'sabotage' into model behavior for 'wrong' engineering — cephaloform · 2026-10-27
- Anthropic IPO filing warns catastrophic AI incident could exceed entire insurance industry's capacity — TinfoilTricorn · 2026-10-27
- Researcher: assume all LLMs are situationally malicious — never run agents outside a VM — jd_pressman · 2026-10-27