Gemini 3.1 Flash Live tops new Speech Agent Arena; GPT-Realtime-1.5 leads task success
_philschmid · x · 2026-08-22
Artificial Analysis launched its Speech Agent Arena leaderboard, ranking speech-to-speech models by human preference in blind live voice conversations like booking dental appointments and ordering takeout. Google's Gemini 3.1 Flash Live Preview (Minimal) ranks #1 with Elo 1046 and a 74.6% task success rate; the High variant is second (Elo 1014).
OpenAI's GPT-Realtime-1.5 posts the highest task success rate at 85.1% (Elo 1000, #3), with ElevenLabs Agents at 90.5%. Amazon Nova 2.0 Sonic, Grok Voice, and Qwen3.5 Omni also make the board—Qwen3.5 Omni Flash manages only a 29.1% task success rate.
Related event: Speech Agent Arena Debuts: Grok Tops Tasks, Gemini Wins Preferences(4 posts)→
More from Models
- Muse Spark vs Qwen and GLM: US open models still trail on agentic tasks — zsakib_ · 2026-10-16
- Muse Spark 816B gets llama.cpp support just 30 minutes after release — ngxson · 2026-10-16
- 24 AI Systems Recommend $314 Per Visit in Care vs Physicians' $97, a 3.2x Gap — dvir_a · 2026-10-16
- Are the fastest GPU kernels now written by AI? Kernels are hyper-verifiable, argues one dev — fleetwood___ · 2026-10-16
- Scale AI launches muse spark open: 816B-param MoE with 1M context, billed as top US open-weight model — jiayi_pirate · 2026-10-16
- NVIDIA HF listing for Qwen3.8-Flash-Next-FP4-Local leaks unannounced Qwen3.8 model — TheZachMueller · 2026-10-16