diffTLM: NeurIPS 2026 Spotlight differentiable vocal tract simulator reconstructs shape from voice

sainingxie · x · 2026-11-06

Eric Chen and Jin Woo's team released diffTLM, a differentiable vocal tract simulator accepted as a NeurIPS 2026 Spotlight. It fills the gap left by physics simulators like MuJoCo MJX for studying sensorimotor learning of speech.

A counterintuitive demo: you can reconstruct the shape of a human vocal tract just from hearing their voice. The team built a "differentiable renderer" for the human voice whose simulations reproduce well-known phonetics properties such as the distribution of formants.

Related event: diffTLM: A Differentiable Vocal Tract Simulator Named NeurIPS 2026 Spotlight(2 posts)→

Original post →

More from Research

Research channel →