Open-source voice-agent leaderboard benchmarks turn detection and tool calls
ivan_digital · reddit · 2026-11-01
Soniqo published a public voice-agent leaderboard alongside its Apache-2.0 open-source speech runtimes (Swift/C++/Android). It combines three evaluations—TurnBench for turn detection, SLURP for spoken tool requests (separating action selection, argument matching, and rejection of unavailable actions), and InstructTTSEval for speech-style instruction following—comparing local and cloud configs. Integrations add conversation-timing predictions: p99 for turn completion and VAP for upcoming speech activity. Scoring protocols and results are open on Hugging Face.
More from coding & agent
- mitsuhiko: an Opus 5.5 agent could re-implement all of CPython in two weeks, no humans — mitsuhiko · 2026-11-01
- DeepSeek shares long-form article on Super-agent design for more autonomous agent systems — deepseek_ai · 2026-11-01
- Karpathy vibe-built HackerTube archives decades of HN-recommended YouTube videos — daniel_mac8 · 2026-11-01
- Running Codex remote on an iPhone via Split View with a self-hosted Proxmox sandbox — Dimillian · 2026-11-01
- DeepSeek quietly drops autonomous coding agent prototype, Bloomberg picks it up instantly — teortaxesTex · 2026-11-01
- Coding tip: append "wdyt?" to your prompt to make Argon review its own plan — cgarciae88 · 2026-11-01