Gemini leaks its own internal instruction "do not use python" into a Google AI Overview
bclavie · x · 2026-11-16
Researcher bclavie shared a rare screenshot: Google's AI Overview accidentally echoed part of Gemini's hidden internal instruction in its output — "do not use python, no computation needed" — before answering the query with a "Direct answer" line.
Internal system instructions are supposed to stay invisible, so seeing one leak into user-facing search results is an amusing slip and highlights prompt-isolation quirks in search AI summaries.
More from Fun
- Remember when AI looked like this and could do nothing else? — w1kke · 2026-11-16
- AI Twitter has more fake insiders than real ones, and nobody knows anything — VraserX · 2026-11-16
- Dev builds custom standalone Artificial Analysis alternative with Pareto frontiers and dark mode — teortaxesTex · 2026-11-16
- "No One Worry": AI Safety Anxiety Meets Deadpan Denial — iruletheworldmo · 2026-11-16
- Gary Marcus shuts down claim that GPT-6 could make GTA 6 in an afternoon — GaryMarcus · 2026-11-16
- Theo's claim that LLMs were 'discovered' by a long autocomplete run draws ridicule — nptacek · 2026-11-16