Voice agent failed 0/5 turns in background noise; adaptive client-side VAD gate fixed it at lower latency
shrapknife · reddit · 2026-11-17
A developer building a WhatsApp lead-qualification voice agent found that server-side VAD never detected the customer stopping when background chatter played, resulting in 0/5 turns answered.
Results across approaches
- Default server-side detector, noise 0.35: 0/5, 1 interruption
- Low sensitivity: still 0/5, 2 interruptions
- No gate with noise 16 dB below speech: still 0/5
- Fixed client gate (0.03) + low sensitivity: 4/4, 3.1 s latency, 5 interruptions
- Adaptive client gate (noise 0/0.12/0.2): 5/5, 4/4, 4/4, 1.1–1.3 s latency, 0 interruptions
Gate design highlights
- Estimate ambient noise as the p90 of the last 50 chunks (5 s) while the gate is closed; threshold = max(0.01, ambient1.8). A min-based estimate failed because bursty chatter's quiet gaps dragged the threshold down
- Warmup: first 10 chunks only measure ambient; open on level > threshold and flush 3 pre-roll chunks (300 ms); hangover keeps it open 6 chunks (600 ms) after level drops
- Key detail: send 100 ms of digital silence per chunk when closed, not nothing — the server-side detector only registers end-of-turn if it actually sees silence
Caveats: small runs (4–5 turns per condition), synthetic noise, TTS customer replies, and no real phone line connected yet.
More from coding & agent
- Clare Liguori to lead AWS reInvent Developer keynote on Nov 30 — FlolightC · 2026-11-17
- REA-Video skill lets Claude reverse-engineer video editing styles; rival claims 20x speed at SSIM 0.96 — toolstelegraph · 2026-11-17
- Developer retries Amp Code after months and finally gets the hype: "completely different" — g3off_who · 2026-11-17
- Dev shares 5 AI automations for service businesses that actually make owners money — Crazy-Movie7633 · 2026-11-17
- SNEWPapers launches remote MCP turning AI tools into US newspaper archive researchers — Jolly-Newspaper-6769 · 2026-11-17
- Team designing open-source mock MCP server, asks community for testing pain points first — OkSkirt1039 · 2026-11-17