Voice Agents Can't Tell Who's Talking: Voice Isolation Cuts WER from 23.3% to 6.2%

thetripathi58 · x · 2026-09-24

Speech-to-text can transcribe audio recorded next to a highway, but when someone walks in mid-sentence, voice agents lose track of who to listen to—mixing background speakers' words into user commands.

Krisp tested 265 real recordings across 11 STT configurations with and without voice isolation:

That's roughly one wrong word in three down to one in sixteen. The recordings and hand-labeled transcripts are available on Hugging Face for verification.

Related event: Voice agents can't tell who's talking; speech isolation cuts STT errors sharply(2 posts)→

Original post →

More from coding & agent

coding & agent channel →