Paper demystifies agent skills: 65.7% work via procedural anchoring, not knowledge injection

dair_ai · x · 2026-08-17

A new arXiv paper, "Demystifying Agent Skills: Why They Work-Until They Don't," systematically answers when skills help, why they work, and where they fail.

Key findings:

Across 8,135 normalized trial records, procedural anchoring accounts for 65.7% of cases where a skill helps, versus only 4.5% for explicit knowledge injection—skills stabilize execution rather than supply missing facts.
Retrieval is a separate bottleneck: as the pool grows from 5 to 100 skills, actual-use precision collapses from 29.6% to 3.3%.
Skills beat Workflow Memory by 6.06 points in matched comparisons.
Skills break under brittle assumptions, incompatible contexts, or insufficient guidance.

Essential reading for anyone maintaining skills for their agents.

Original post →

Paper demystifies agent skills: 65.7% work via procedural anchoring, not knowledge injection

More from coding & agent