Five production AI agent failure patterns and the telemetry that catches them
Bonree · reddit · 2026-11-12
The author (a Bonree employee, disclosed) catalogs five failure patterns that recur when AI agents move from demo to production, plus the observability needed to catch each:
- Silent wrong answers: a tool fails inside a "successful" response and the agent answers confidently anyway. → Record tool outcomes per step, separate from transport status; flag runs where a final answer follows a failed/empty tool call.
- Loops and runaway retries: near-identical tool calls repeat, cost drifts upward. → Track step counts, repeated argument signatures, alert on outlier run length.
- Latency with no owner: model, retrieval and downstream times each look fine individually. → Split model/tool/dependency time on a single trace.
- Cost growing faster than traffic: context accumulates, large tool results passed back in full. → Track input tokens per step and tool result size by agent and tool.
- Irreproducible failures: nobody recorded which model/prompt/tool versions were involved. → Attach version metadata to every run.
The common thread: agent observability must work per step, not per request, and share one trace with infrastructure telemetry. The author also describes Sage AI, an AIOps agent in Bonree ONE that assists diagnosis on the same telemetry, and invites others to compare notes.
More from coding & agent
- Meta open-sources Astryx, the design system behind 13,000+ internal apps — victor_explore · 2026-11-12
- 8 Parallel Agents Code an 83-Second Anime Short in Under 3 Hours — FinanceYF5 · 2026-11-12
- Fable 5.5 codes an 83-second animated short in under 3 hours, zero video models — FinanceYF5 · 2026-11-12
- Running bots as an expert team, author pivots to a scored "Checked Loop" workflow — JoeJustice · 2026-11-12
- Dev makes an AI agent CEO of a puzzle game company, shipping a new game daily — RichardsonDx · 2026-11-12
- Why AI agents forget: a primer on the memory layer missing from agent architecture — sharpeye_wnl · 2026-11-12