DirtyMoCap recovers 3D motion from noisy unordered markers, with 100x faster CUDA solver

jamestagg · x · 2026-10-12

A Westlake University-led team introduces DirtyMoCap (SIGGRAPH Asia 2026), a marker-layout-free motion capture framework that recovers 3D human motion from sparse, noisy, unordered marker clouds. It maps unordered observations to fixed 'proxy anchors' (joints + surface points), tracks them with a recurrent sliding-window architecture, then fits SMPL-H via a custom differentiable Gauss-Newton solver with learned confidence/smoothness/prior weights. A single model outperforms configuration-specific SOTA baselines on joints and vertices, and the custom CUDA solver gives up to 100x speedup over PyTorch. They also release HKMALA-Motion: 134 Kung Fu sequences, 3 hours, 22 styles. Paper and code are public.

Original post →

More from Embodied

Embodied channel →