Voice agent latency isn't mostly the LLM — turn detection can eat ~1 second

anandwana001 · reddit · 2026-11-23

The author (an Agora dev advocate, disclosed) breaks down where voice agent latency goes: real-time network 150–300 ms; VAD/turn detection 720–940 ms (640 ms silence window); STT to last word 400–700 ms; LLM first token 250–1000 ms; TTS first byte 100–350 ms.

The biggest hidden cost is deciding the user finished talking — wait too long and it feels slow, jump early and it interrupts. Agora's Conversational AI Engine addresses this layer with semantic turn detection (English/Chinese), interruption handling, and filler phrases, plus bring-your-own LLM/TTS/MCP or managed mode. Quickstart via npx skills add AgoraIO/skills in Claude Code or Cursor.

Original post →

More from coding & agent

coding & agent channel →