Dev's honest scoreboard: pattern rules catch under 25% of prompt injections, guard model catches most

colinmcnamara · x · 2026-10-15

At his AustinLangChain talk, colinmcnamara live-tested whether his own router could resist prompt injections. The honest scoreboard: his current pattern-list approach caught under a quarter of them, while the guard model he benchmarked caught most. Wiring the guard model in is the next step.

Related event: Live test shows router rules fail against prompt injection; guard models needed(2 posts)→

Original post →

More from coding & agent

coding & agent channel →