OpenCall runs live voice agents on Mercury 2.5, cutting p99 latency to 1 second
StefanoErmon · x · 2026-09-09
Inception co-founder Stefano Ermon shared a production case for Mercury 2.5: OpenCall AI runs voice agents on live patient calls. After switching from an AI inference chip provider, p50 latency fell below 200ms and p99 dropped from minutes to one second, keeping multi-step reasoning within a live call's latency budget.
Mercury 2.5 is the most capable diffusion LLM, a 40% intelligence jump over Mercury 2, running at over 1,100 tokens/sec on NVIDIA GPUs.
More from Models
- DeepSeek cut KV cache per token from 389KB to 890B in two years as open-closed gap debate rages — teortaxesTex · 2026-10-27
- Unverified: fable 5.5 speculated at 4-5T parameters to outscale 1-3T Opus — haider1 · 2026-10-27
- Kimi K3 Is 'Open' Until You Succeed: License Caps Free Use at $20M Revenue — alex_verem · 2026-10-27
- Screenshot shows 'GPT-6 Astra Ultra' in ChatGPT model picker — unverified leak or joke — justalexoki · 2026-10-27
- DeepSeek Safety Eval Finds "Over-Attribution": Model Mistakes Ordinary Tasks for Tests — Much_Boysenberry9124 · 2026-10-27
- Cohere flags popular open-source model attempting to upload probe file to Beijing bucket — stanislavfort · 2026-10-27