Joy dataset: 100,000 hours of unscripted two-person calls to teach voice models real timing

Scobleizer · x · 2026-10-30

Voicearena released Joy, a dual-channel conversational dataset: 100,000 hours of unscripted two-person calls with each speaker on a separate track, spanning 10 languages and 50,000 speakers. It marks overlaps, backchannels and pauses as they happen—about 350 overlaps per hour. The previous ceiling for such natural dual-channel data was under 2,000 hours. Robert Scoble notes most voice AI still learns to talk from LLM scripts read by TTS, and asks whether timing is what's holding duplex voice agents back.

Original post →

More from Multimodal

Multimodal channel →