TCP4D: unified TCP tracking-and-generation model for robot manipulation, adapts with 10 demos

Haosong Peng · hf · 2026-11-18

TCP4D uses an embodiment-agnostic tool-center-point (TCP) action space and a shared 4D scene representation to both track observed TCP motion and generate future TCP trajectories. From monocular video and initial 2D TCP queries, the tracker recovers metric SE(3) poses and gripper states; the generator samples the same 4D features with robot observations and language instructions to predict future TCP states.

Original post →

More from Embodied

Embodied channel →