ICML Paper: Adaptive Failure Taxonomy
wzenus · x · 2026-07-11
An ICML FAGEN Workshop paper titled "Fantastic Adaptive Taxonomies and How to Use Them" won the Best Paper Award. The author outlined the core concept: failure taxonomies can transition from static, hand-crafted designs to being dynamically and adaptively generated based on agent weaknesses and tasks.
Problem Addressed
Traditional approaches often use preset failure taxonomies like MAST, but the author argues these fixed taxonomies fail to accurately reflect actual agent behaviors.
Primary Use Cases
The paper demonstrates three applications for adaptive taxonomies:
- As a test-time scaling tool to serve best-of-N judges
- As a mutation feedback mechanism within optimization loops
- As runtime feedback signals for coding agents
Core Methodology
- Discovering failure modes by observing agent rollouts
- Dynamically constructing a classification system better aligned with current tasks and weaknesses based on these observations
- Treating the taxonomy itself as an iteratively optimizable object, rather than a fixed set of labels
Related event: Adaptive Failure Taxonomies Win ICML Workshop Best Paper(3 posts)→
More from coding & agent
- Team-level AI agents: where should shared context and history live? — Al_Grigor · 2026-09-11
- Trust layer for money-moving AI agents: out-of-mandate actions can't get signed — Arpitbuilds · 2026-09-11
- Chaining dependent MCP tool calls: no rollback, duplicate risk — agentrsdg · 2026-09-11
- DeepMind-led paper makes design docs the source of truth, code disposable — SMART regenerates in 1.5-3h for ~$100 — Roger_M_Taylor · 2026-09-11
- Agent-built classifier labels 192k docs for $0.70 vs $13-26 with frontier LLMs — vanstriendaniel · 2026-09-11
- MathModelAgent gains traction: auto-solves math modeling and writes a submission-ready paper — jihe520 · 2026-09-11