Voice agent passes 15 metrics but customers still complain — what's not being measured?

georgeamine · reddit · 2026-11-17

A developer describes a common eval gap: their voice agent passes 15 metrics (task completion, tool-call success, latency, multiple LLM judges), yet support keeps forwarding complaints from calls that look fine on paper. Only manual call review surfaces real issues like the agent repeating itself after long pauses or confusing appointment-time phrasing — impractical at hundreds of calls a day. They ask whether others cluster failed calls or run batch audits to discover failure modes no metric covers yet.

Related event: Voice agent passes 15 metrics yet users still complain(2 posts)→

Original post →

More from coding & agent

coding & agent channel →