Looking for a model to label each subtitle line with the speaker's identity

dtdisapointingresult · reddit · 2026-09-24

For a fan subtitling project, the author needs to convert unlabeled English TV subtitles into per-line speaker-attributed format. With 15 main characters, they're willing to prep one reference voice sample per actor (Alice.wav, Bob.wav) and want automatic speaker identification, marking unrecognized extras as Unknown #1/2/3 for manual cleanup (1% of lines). They ask whether an existing model can do reference-audio-based speaker labeling.

Related event: Subtitle maker seeks speaker diarization solution for 15-character show(2 posts)→

Original post →

More from Multimodal

Multimodal channel →