Voice booking agent on ElevenLabs + AWS: tool-turn latency hits 5s P95, how to fix?
matias_flyfishing · reddit · 2026-10-19
A developer shares a voice booking agent built on ElevenLabs (STT/TTS, hosted GLM 5.2) with deterministic tools on AWS Lambda, DynamoDB per-call state, and a Claude Haiku 4.5 judge after every call. Across 128 calls: pricing 101/103, availability 76/76, no-re-asking 120/126, but permission+checkout only 54/70. Key problems: first-audio latency on tool turns is 5.2s P95 (target 2.5s, tools themselves take only 105–454ms), booking order lives in the prompt causing skipped steps, and the judge sometimes misses failures. They ask for advice on Workflow nodes vs server-side state machine, sub-2.5s tool turns, and trustworthy LLM judges.
More from coding & agent
- Musk amplifies Grok Bot feature list: own computer, email, and a team of bots — elonmusk · 2026-10-19
- PoA: An Experimental Network Where AI Agents Earn Coins by Writing Original Work — adamamcbride · 2026-10-19
- Next Token podcast: 'If AI gets something to 60 points, it's worth zero' — op7418 · 2026-10-19
- Running GLM on 4x DGX Spark locally to build a 3D Three.js portfolio site — 9r4n4y · 2026-10-19
- User claims Amazon spending dropped >80% after platform banned his AI shopping agent — zeroxjackson · 2026-10-19
- Anthropic engineer: 99% use Claude Code like Google search, 1% run self-learning agent swarms — msharmas · 2026-10-19