Heads Of Security: paper pinpoints and rewires attention heads behind prompt injections

jonasgeiping · x · 2026-10-31

A new paper, "Heads Of Security", proposes a prompt injection defense inspired by interpretability work on attention head specialization: the authors identify which attention heads are responsible for successful prompt injections and adjust their attention patterns to block them. The accompanying meme (a three-headed dragon where head 3 happily ignores previous instructions, getting bonked by a security doge) illustrates the per-head mitigation idea — an interp-driven new direction against injection attacks.

Original post →

More from Safety

Safety channel →