CTC-TTS paper replaces MFA with CTC alignment for low-latency dual-streaming TTS
kastnerkyle · x · 2026-09-13
A new arXiv paper proposes CTC-TTS, an LLM-based dual-streaming text-to-speech system. It replaces pipeline-heavy MFA forced alignment with a CTC-based neural aligner and introduces a bi-word interleaving strategy instead of fixed-ratio text-speech token interleaving.
Two variants are designed:
- CTC-TTS-L: token concatenation along sequence length, for higher quality;
- CTC-TTS-F: embedding stacking along feature dimension, for lower latency.
Experiments show CTC-TTS outperforms fixed-ratio interleaving and MFA-based baselines on streaming synthesis and zero-shot tasks. The paper was accepted at INTERSPEECH 2026.
More from Multimodal
- Element Forge: open-source editable AI VFX for real footage in ComfyUI — zitroffell · 2026-10-30
- Claymation body horror on 8GB: three wrong settings, not the GPU, made local renders slow — roro9- · 2026-10-30
- AI-generated Haribo Starmix bean bag product shot looks like a real catalog page — Delahuntagram · 2026-10-30
- MiniMax LoRA creator ships open-source ComfyUI alternative to Higgsfield's Influencer Studio — infroy28 · 2026-10-30
- Scenario open-sources 3D OS: 80 agent skills taking sketches to game-ready assets — Scobleizer · 2026-10-30
- Open-source ComfyUI app reshoots footage keeping camera and framing, swapping scenes — 3dkvisual · 2026-10-30