Real-time voice agent finds Silero VAD too slow, seeks ultra-low-latency speech-offset detection
Lonligrin · reddit · 2026-09-09
A developer building a real-time voice agent with a speculative response pipeline found Silero VAD v6 too slow at detecting when the user stops speaking. Their architecture needs to trigger speculative ASR and LLM generation the moment possible silence appears, so they'd happily trade false positives for ultra-low latency — speculative work can simply be canceled.
They currently roll a lightweight RMS-energy detector that emits an early "possible silence" signal. Questions: what do others use for ultra-low-latency speech-offset detection; are there VADs that react to the first silent frame without large buffer windows; local, CPU-friendly solutions preferred.
More from coding & agent
- A Curated Paper Collection on Harness Engineering from YC Paper Club — dair_ai · 2026-09-09
- This agent prints a personalized AI morning newspaper from your calendar and email while you sleep — bookwormengr · 2026-09-09
- DAIR.AI compiles 21-paper Harness Engineering collection tracing the loop from GPT-2 to self-rewriting agent harnesses — omarsar0 · 2026-09-09
- Meta's Personal AI Agent Muse Can Pay Bills, Book Dates in Early Hands-On — jeff_weinstein · 2026-09-09
- exe.dev deep dive: ssh to a persistent Linux VM in half a second, priced like a folder — davidcrawshaw · 2026-09-09
- Harvey post-trains RLM agents for M&A diligence, lifting benchmark pass rate from 23% to 62% — lateinteraction · 2026-09-09