Postmortem of a Hindi-English voice agent for fintech: number readback and real concurrency were the real problems
admrys · reddit · 2026-08-25
The author built a Hindi-English (Hinglish) voice agent for an Indian fintech handling payment reminders, KYC follow-ups and account queries, and shares a candid postmortem of six months of work.
The assumed hard part—LLM understanding Hinglish—wasn't; making the agent speak correctly was:
- Number readback: amounts, dates and reference numbers must be read digit by digit; early on full-English number chunks inside Hindi sentences felt scammy—fatal for trust in fintech.
- Code-switch stutter: many TTS engines pause or shift accent at the Hindi↔English boundary; people hang up.
- Latency under load: single-call demos looked fine, but at real outbound-call concurrency one provider spiked past 800ms. Measure at YOUR real concurrency—the demo number is a lie.
- Compliance: RBI-adjacent scrutiny, data residency and SOC 2 disqualified several otherwise-good options.
The fix: a TTS treating Indian code-mixing and number normalization as first-class, plus testing through the actual telephony pipe at real concurrency. Once readback was clean, pilot trust and completion rates jumped. Meta-lesson: stop evaluating on "which voice sounds nicest" and start evaluating on correctly saying an amount, a date and a reference number in a Hinglish sentence, over a phone line, at scale.
More from coding & agent
- gitea-mcp: MCP Server with 186 Tools for Gitea API Integration — modelcontextprotocol · 2026-08-25
- Long-Horizon Agent Dev Pain: Not Enough Time to Run Full Rollout — agihouse_org · 2026-08-25
- AGI House Hackathon Recap: Long-horizon Agents Need Verification, Not Just Memory — agihouse_org · 2026-08-25
- Terminal-Bench 3.0: Top Model Score Plummets to 43.5% as Agents Fail to Fix Root Causes — ajratner · 2026-08-25
- Spine-Branch Framework Boosts Multi-Agent Success by 16.5% — ZhiyuChen4 · 2026-08-25
- Anthropic Showcases Creative Claude Code Projects: From Medical Viewers to 3D Streets — 机器之心 · 2026-08-25