AI2 open-sources MolmoMotion: 4B VLM forecasting 3D point trajectories with code and data
rsasaki0109 · x · 2026-10-03
AI2 has open-sourced the MolmoMotion repo on GitHub. MolmoMotion is a 4B vision-language model predicting 3D point trajectories from natural-language action instructions: given a short RGB observation history, user-specified 2D query points with initial 3D positions, and a language description, it forecasts each point's 3D trajectory up to 2 seconds ahead. The repo ships the autoregressive (AR) variant from the paper, the MolmoMotion-1M training corpus, and the PointMotionBench evaluation suite, plus data-generation and robotics modules. The motion prior transfers to robotics planning and motion-guided video generation.
More from Embodied
- ETH's Anymal robot completes 10km autonomous alpine hike with VLM-guided ROAM system — ChongZzZhang · 2026-11-19
- iFixit tears down Apple HomeView: lots of glue and 'endless frustration' — Resident-Fall4351 · 2026-11-19
- Removing human video drops robot OOD success from 60% to 7%: generalization comes from human video — gui_penedo · 2026-11-19
- PSYONIC's prosthetic Ability Hand now used by 90+ robotics orgs, raising Series A — DhowCIO · 2026-11-19
- Simulator misspecification breeds overconfidence: sim-to-real study on SPEED+ — Nikolay Dolgov · 2026-11-19
- Doppel world model renders the robot body and beats action-only baselines across 8 embodiments — mangahomanga · 2026-11-19