ICML Paper: Adaptive Failure Taxonomy
wzenus · x · 2026-07-11
An ICML FAGEN Workshop paper titled "Fantastic Adaptive Taxonomies and How to Use Them" won the Best Paper Award. The author outlined the core concept: failure taxonomies can transition from static, hand-crafted designs to being dynamically and adaptively generated based on agent weaknesses and tasks.
Problem Addressed
Traditional approaches often use preset failure taxonomies like MAST, but the author argues these fixed taxonomies fail to accurately reflect actual agent behaviors.
Primary Use Cases
The paper demonstrates three applications for adaptive taxonomies:
- As a test-time scaling tool to serve best-of-N judges
- As a mutation feedback mechanism within optimization loops
- As runtime feedback signals for coding agents
Core Methodology
- Discovering failure modes by observing agent rollouts
- Dynamically constructing a classification system better aligned with current tasks and weaknesses based on these observations
- Treating the taxonomy itself as an iteratively optimizable object, rather than a fixed set of labels
Related event: Adaptive Failure Taxonomies Win ICML Workshop Best Paper(3 posts)→
More from coding & agent
- Non-devs should buy Claude Code or Codex themselves, says a reposted tip — HankYeomans · 2026-07-23
- LangChain says the real agent problem is loop engineering, not just execution — LangChain · 2026-07-23
- Teaser: Orchestrator System with Dynamic Multi-Model Routing and Task Splitting — omarsar0 · 2026-07-23
- Reddit asks how to manage email identity for AI agents — BlakSavageGaming · 2026-07-23
- Developer Uses GPT to Curate Best Codex and ChatGPT Work Use Cases from X — nickbaumann_ · 2026-07-23
- Microsoft Build 2026: Introducing Autopilot Category with Personal Agent Scout — emmanuelvivier · 2026-07-23