Facto: factorized speech tokenizer yields stabler tokens for SpeechLLMs at NeurIPS

kastnerkyle · x · 2026-11-21

Researchers from Ubisoft La Forge, Concordia and Stellenbosch present Facto (NeurIPS 2026, arXiv:2611.18898): a speech tokenizer that first disentangles time-varying information (content + prosody) from static components (speaker identity, recording conditions) via a simple linear factorization, then clusters the factorized space.

Key points:

Original post →

More from Multimodal

Multimodal channel →