AI2's MolmoMotion hits NeurIPS Highlight: 3D point-trajectory forecasting lifts robot pick-and-place to 76.3%

k7agar · x · 2026-10-03

MolmoMotion, a 3D point-trajectory forecasting model from AI2, UW and UNC, was selected as a NeurIPS 2026 Highlight paper with everything open-sourced.

Downstream: fine-tuned on DROID real-robot videos, initializing a manipulation policy with it lifts pick-and-place success from a Molmo 2 baseline of 56.0% to 76.3%; its trajectories also serve as explicit motion-control signals for image-to-video generation, beating the base model on all five motion metrics.

Related event: AI2 Open-Sources MolmoMotion for Language-Guided 3D Point Trajectory Prediction(3 posts)→

Original post →

More from Embodied

Embodied channel →