Open Source Otoscope: Pinpoints Which Layer Broke in Voice Agents
rachittshah · x · 2026-08-24
Voice agents can pass transcript evals but still fail in user experience (e.g., talking over the caller). Otoscope is an open-source tool that uses counterfactual blame attribution to identify the broken layer. By swapping one piece of the call trace with a perfect version and checking if the failure disappears, it pinpoints the cause. It covers 60 addressable failure modes and includes a harness with an agent that has 7 planted bugs for testing.
More from coding & agent
- Meta Paper: Training Agents to Decide When to Use Memory via RL — rohanpaul_ai · 2026-08-24
- Managing Knowledge Base for Voice AI Coach — Bemaitis · 2026-08-24
- Project completed in less than a day with Claude Code — fredodurand · 2026-08-24
- Low-Level Understanding > Syntax in the LLM Era — Livelandrrr · 2026-08-24
- MIT professor built an eclipse travel planner web app with Claude Code in under a day — fredodurand · 2026-08-24
- Defining Success for Agent CRM Handoffs — Striking_Pattern_434 · 2026-08-24