IBM ships two small open models trained to ignore prompt injections in documents

MajesticPuzzler · reddit · 2026-11-14

Per a post circulating on r/LocalLLaMA, IBM has released two small open models specifically trained to ignore instructions hidden inside documents — baking prompt-injection resistance into the model itself.

Prompt injection is the scariest failure mode for RAG pipelines and agents that read web pages or user uploads. The usual advice has been to defend outside the model: sanitize retrieved text, keep data and instructions separate in the prompt, and restrict which tools an agent can call.

The poster opens discussion on three questions: do you rely on the model to ignore injected text, or guard at the pipeline level? Has anyone actually tested their RAG app against poisoned documents, and what broke? And would a small injection-resistant model as a filter step be worth the added latency?

Related event: IBM Open-Sources Small Models Trained to Resist Prompt Injection(2 posts)→

Original post →

More from Models

Models channel →