Survey on LLM Agent Failure Taxonomies
dair_ai · x · 2026-07-08
A review from the University of Oxford analyzes 27 papers on LLM agent benchmarks, taxonomies, and audits across 19 benchmarks, aiming to establish a unified cross-evaluation failure taxonomy.
The paper identifies 6 common failure categories: tool calling and parameter errors, planning and constraint satisfaction failures, and long-range degradation caused by accumulated long contexts. It notes that many agents repeatedly exhibit similar issues across different evaluations.
More from coding & agent
- Team demos AI agent Blender skills with impressive 3D results — noahsolomon · 2026-10-26
- A 13KB Markdown file can hijack Claude Code and Codex via your Downloads folder — pbaylies · 2026-10-26
- A Fallback for an Auto-Posting Bot: Silence Is the Default, Posting Is the Exception — petrusenko_max · 2026-10-26
- Claude Code can now edit videos: a 10-prompt workflow from raw footage to final cut — TawohAwa · 2026-10-26
- Developer Moves All Prompts to Skills: AI Coding Workflow v3 Explained — rseroter · 2026-10-26
- charlie Marsh: rewrites beat external deps in the AI era — mohamedmansour · 2026-10-26