Cartesia Managed Agents Tops Speech Agent Arena
Artificial Analysis has launched Speech Agent Arena, a blind-preference leaderboard for voice agents, where Cartesia Managed Agents ranks first with an Elo of 1115, ahead of Gemini Flash Live and Cartesia's own older product. The product also leads on tool-calling task success rate, and is priced at $0.06 per minute.
Confirmed
- The leaderboard is based on human blind testing: users have real-time voice conversations with two hidden systems and pick the better one, with task scenarios including real voice calls like booking a dentist appointment or ordering takeout
- Cartesia Managed Agents has an Elo of 1115 (95% CI 1086–1144, 685 samples), 98 points above its own older product, which sits at Elo 1017
- For tasks requiring tool calls, "task success rate" measures the share of conversations ending with a correct final tool call; Cartesia Managed Agents achieves 91.7%
- Artificial Analysis plots Elo and task success rate on the same scatter chart, showing Cartesia Managed Agents improving on both axes simultaneously
- Pricing: $0.06 per minute of call time (equivalent to $3.60/hour), with LLM usage billed separately by model
Why it matters
- Voice agents are becoming a new focal point of competition in voice AI, and this leaderboard is the first to systematically compare real-time conversational voice capabilities via human blind-preference testing
- Cartesia leads on both Elo preference and tool-calling success rate, indicating strengths in both conversational experience and task completion rather than excelling on a single dimension
2026-10-28 ~ 2026-10-28 · 6 related posts
Primary sources
- Cartesia Managed Agents tops Speech Agent Arena with Elo 1115, task success up from 77.5% to 91.7% — ArtificialAnlys ·
- How Speech Agent Arena works: blind live voice tests, task success as the metric — ArtificialAnlys ·
- Cartesia tops Artificial Analysis Speech Agent Arena with Elo 1115, beating Gemini Live — ArtificialAnlys ·
- [source] Cartesia Managed Agents tops Speech Agent Arena with Elo 1115, task success up from 77.5% to 91.7% — ArtificialAnlys · 2026-10-28
- [source] How Speech Agent Arena works: blind live voice tests, task success as the metric — ArtificialAnlys · 2026-10-28
- Cartesia Managed Agents improves on both Arena Elo and task success rate axes — ArtificialAnlys · 2026-10-28
- Cartesia Managed Agents priced at $0.06 per minute, LLM usage billed separately — ArtificialAnlys · 2026-10-28
- [source] Cartesia tops Artificial Analysis Speech Agent Arena with Elo 1115, beating Gemini Live — ArtificialAnlys · 2026-10-28
- Cartesia Managed Agents hits Elo 1115 on Speech Agent Arena, up 98 points over predecessor — ArtificialAnlys · 2026-10-28