Voice AI's next bottleneck: turn-taking, not latency

机器之心 · wechat · 2026-11-15

A Machine Heart PRO deep-dive on voice AI's shift from latency to turn-taking. End-to-end delay is now 150-300ms, matching the 200ms human turn-taking gap, yet systems still interrupt or leave awkward silences because endpointing relies on silence thresholds alone. The piece surveys full-duplex approaches, Zhejiang University's L0-L3 architecture taxonomy, continuous prediction, and open problems in evaluation, controllability, and long-run stability.

Original post →

More from Multimodal

Multimodal channel →