Why 160ms? Boson AI explains the step size behind its Realtime Duplex voice agents

smolix · x · 2026-11-07

Alex Smola of Boson AI published a detailed rationale for why Higgs Realtime Duplex uses a 160ms decision step:

The real anchor is decision speed: recognizing an animal in a photo takes 150ms, simple reactions 200ms. Conversation turn gaps average 200ms across languages, yet producing a single word takes 600ms. Each 160ms step in Duplex is one decision (speak, stay quiet, backchannel, yield, interrupt); audio frames and face latents go out within a step without re-deciding.

Faster isn't feasible: each step is a forward pass, so smaller steps mean smaller batches and worse GPU utilization; slower adds turn-taking lag. The post also cites Google's 2009 finding that +100ms latency cost 0.2% of searches, and Core Web Vitals' 200ms "good" threshold.

Related event: Why Higgs Realtime Duplex Uses a 160ms Decision Step(3 posts)→

Original post →

More from coding & agent

coding & agent channel →