whatbroke: Catching AI Agent Behavior Regressions
The open-source tool whatbroke helps developers catch hidden AI agent behavior regressions by comparing trajectory diffs between runs, identifying issues like silently skipped tool calls that text outputs fail to reveal.
2026-07-25 ~ 2026-07-25 · 2 related posts
- Episode 1: New Tool Detects Silent Agent Regressions After Model Switches(2026-07-22, 2 posts)
- Episode 2: whatbroke: Catching AI Agent Behavior Regressions(2026-07-25, 2 posts)
- Whatbroke diffs AI agent traces to catch tool-call regressions after model swaps — Impossible-Alarm-738 · 2026-07-25
- GitHub shows whatbroke, a tiny offline diff tool for AI agent behavior — JeffLadish · 2026-07-25