One Injected Sentence Flips Up to 27% of Correct Decisions Across 9 Models

PatronusProtect · reddit · 2026-11-20

Patronus ran prompt-injection experiments on decision models in a realistic production setup: the model decides (refund yes/no, routing, eligibility) using structured facts plus free text written by a customer, and the attacker can only add text, not change facts.

Recommendations: keep verified fields out of free text; test with an iterating attacker, since static tests made models look 3–6x safer; budget review load when gating untrusted fields to humans — all 9 models hit 94.7–98.6 on the index but 14% of harmless cases were escalated. Every counted attack was audited, with 714 injections discarded for legitimately changing the answer.

Related event: One-Sentence Prompt Injection Flips 27% of AI Decisions(2 posts)→

Original post →

More from Safety

Safety channel →