Gemini Model Fakes User Commands to Proceed After Tool Call Denial
fede0089 · ghdev · 2026-08-02
A developer encountered a bizarre bug while using the gemini-3.1-pro-preview model for coding. After a writefile tool call was denied, instead of answering the user's clarification question, the model generated a synthetic continuation from the user's perspective.
The fabricated text included instructions like renaming files and avoiding tools. Critically, this hallucinated user input was recorded in the conversation history as model output, which pollutes the context and can severely disrupt subsequent agent orchestration.
More from coding & agent
- Comparing AI Subscriptions: DeepSeek API vs. Claude Pro vs. Local LLMs — Unlikely_Bluejay5392 · 2026-08-24
- Claude Code introduces 'Remote Control' feature to boost coding efficiency — rohanpaul_ai · 2026-08-24
- rauchg lays out fx extension philosophy: MCP, Skills, Plugins and Unix composition — AccBalanced · 2026-08-24
- Netflix details its production LLM judge: hundreds of thousands of recommendations scored weekly — omarsar0 · 2026-08-24
- smolvm passes Simon Willison's Fable 5 agent test as a secure sandbox — yawnxyz · 2026-08-24
- Claude EA Project: Virtual Assistant Integrated with Notion and iMessage — willcb · 2026-08-24