Speech-to-Speech Model Analysis: Grok Leads Task Success, Gemini Top Preference
ArtificialAnlys · x · 2026-08-21
Artificial Analysis released a comprehensive comparison of Speech-to-Speech models and providers, evaluating reasoning quality, conversational dynamics, speed, and pricing.
- Overall Preference: Gemini 3.1 Flash Live Preview leads with 1046 Elo at $1.50/hour.
- Task Success Rate: Grok Voice Think Fast 2.0 High achieves 94.7% at $4.80/hour.
- GPT-Realtime: GPT-Realtime-2.1 High follows with a 91.5% task success rate.
The report includes detailed leaderboards, benchmarking methodology, and example conversations.
Related event: Speech Agent Arena Debuts: Grok Tops Tasks, Gemini Wins Preferences(4 posts)→
More from Models
- Muse Spark vs Qwen and GLM: US open models still trail on agentic tasks — zsakib_ · 2026-10-16
- Muse Spark 816B gets llama.cpp support just 30 minutes after release — ngxson · 2026-10-16
- Are the fastest GPU kernels now written by AI? Kernels are hyper-verifiable, argues one dev — fleetwood___ · 2026-10-16
- Scale AI launches muse spark open: 816B-param MoE with 1M context, billed as top US open-weight model — jiayi_pirate · 2026-10-16
- NVIDIA HF listing for Qwen3.8-Flash-Next-FP4-Local leaks unannounced Qwen3.8 model — TheZachMueller · 2026-10-16
- Muse Spark Open, billed as the most capable US open-weight model, lands on Nebius day one — Arindam_1729 · 2026-10-16