How it works: SAM 3D for geometry, SegviGen for parts, point tracks for joints

mangahomanga · x · 2026-09-17

Follow-up detailing the pipeline: SAM 3D reconstructs geometry, SegviGen separates the mesh by parts, and 3D point tracks recover how parts move; the team then fits joints, aligns recovered hand motion with the object, and replays the interaction in MuJoCo.

Related event: JHU's Track, Articulate, Act Rebuilds Articulated Objects from Monocular Video for Robots(5 posts)→

Original post →

More from Embodied

Embodied channel →