Agent Prompts Have No Guarantees: Injected Text Can Override Your Instructions

mmitchell_ai · x · 2026-10-23

mmitchellai warns that agents process web pages, files, emails and tool outputs, and text in that data can act as commands the agent follows over yours (prompt injection), so even perfectly worded instructions carry no guarantee of being obeyed.

The same instruction isn't even stable across runs: minor rephrasing changes behavior, and a prompt that works on one model can fail on another, since output is sampled stochastically rather than deterministically.

Related event: Hugging Face AI safety lead: natural language instructions are not control over AI agents(6 posts)→

Original post →

More from coding & agent

coding & agent channel →