TurboT2VA distills 19B text-to-video-audio model to 4 steps for 54.67x speedup
青稞AI · wechat · 2026-09-25
Tsinghua's TurboT2VA accelerates LTX-2, a 19B open-source joint text-to-video-audio model. Training distills the 40-step teacher into a 4-step student via a three-stage curriculum: discrete consistency distillation warmup, continuous consistency distillation refinement, then joint sCM+DMD optimization—establishing trajectory structure first before distribution matching, with modality-specific timestep shifts and loss normalization. Inference stacks W8A8 quantization, SageSLA sparse attention, text-padding compression and fused kernels.
At 1024×1792 and 121 frames on a single NVIDIA H20, generator latency drops from 318.74s to 5.83s, a 54.67x speedup, while audio-visual alignment metrics improve. Paper and code (thu-ml/TurboDiffusion) are public.
Related event: TurboT2VA Speeds Up LTX-2 Audio-Video Generation 54.67x via Distillation(2 posts)→
More from Multimodal
- MiniMax H3-Image image model debuts on Tencent's Miora, free to try Nov 11–17 — aziz4ai · 2026-11-11
- MiniMax H3 hits 100 days open-source: 1,472 derivative models, 148M+ downloads — linoy_tsaban · 2026-11-11
- MiniMax H3-Image explodes an espresso machine photo into 15 labeled parts — Charlietest123 · 2026-11-11
- Indie dev built a tool that clips best moments from 4-hour streams in 30 minutes — kissaadams · 2026-11-11
- Non-Blender user makes a video in 30 minutes with Claude and Seedance — FinanceYF5 · 2026-11-11
- Whimsical Woodland: A Watercolor AI Art Prompt Template for Dreamy Forest Scenes — LudovicCreator · 2026-11-11