VoiceArena launches Diarization Bench: 12 systems, NVIDIA Nemotron 3 leads at 14.72% DER
rohanpaul_ai · x · 2026-09-24
VoiceArena launched Diarization Bench, scoring 12 speaker-diarization systems on 139 real-world conversations (rooms, calls, constant interruptions) with a single metric: diarization error rate. NVIDIA's Nemotron 3 leads at 14.72% DER — but with a 250 ms timing collar it scores 4.29%, revealing how sensitive results are to the tolerance window around speaker changes. Accuracy degrades sharply with overlapping speech and more speakers. It joins STT, TTS, and conversational-agent boards on VoiceArena.
More from Research
- BFL shows FLUX 3 Action flying a simulated drone, hinting at broader uses — bfl_ai · 2026-09-24
- BFL open-sources 7B world action model FLUX 3 Action, tops RoboLab 6.1pp ahead — bfl_ai · 2026-09-24
- IKEA Assembly Benchmark: Top Model Score Jumped From 28% to 80% in 10 Months — emollick · 2026-09-24
- Juan Perdomo, researcher on performative prediction, joins NYU as assistant professor — thegautamkamath · 2026-09-24
- Claude Opus 5.5 and GPT-6 Sol land on Biomni Lab research platform — KexinHuang5 · 2026-09-24
- JevK5 open decision model ranks #2 of 76 on JevBench, outputs calibrated probabilities in ~13ms — airesearch12 · 2026-09-24