MolmoAct2 Controls Robotic Arm Zero-Shot
DJiafei · x · 2026-07-10
MolmoAct2 is introduced as an action-inference model capable of running zero-shot on the SO-ARM101 robotic arm, emphasizing that it works out of the box "without any training."
It has now been integrated into LeRobot, covering the entire pipeline:
- Fine-tuning: Supports full-parameter or LoRA
- Evaluation: Provides a ready-to-use evaluation workflow
- Real-world deployment: Can be directly deployed onto physical robots
Technically, it combines the Molmo2-ER vision-language backbone with a flow-matching action expert, translating images, language, and embodiment states into action chunks. The post also details the hardware requirements: bf16 inference takes about 12GB of VRAM, LoRA fine-tuning can be done on a single 24GB GPU, and calibration corrections are already built into the checkpoint.
More from Embodied
- Tesla Robotaxi expands to Orlando and Tampa, reaching seven U.S. markets — XFreeze · 2026-07-22
- Hands-on robotics workshop on Saturday may be the last in-person session before August — StewartalsopIII · 2026-07-22
- NVIDIA pitches World Foundation Models as a way to scale physical AI data generation — MonaJalal_ · 2026-07-22
- RoboMME Podcast Preview: Benchmarking Memory for Robotic Policies — chris_j_paxton · 2026-07-21
- Gritt says an 8-person crew now installs 3,000 to 4,000 solar panels a day — HaktanSuren · 2026-07-21
- A helium-powered flying robot whale aims to be a quiet companion pet — chris_j_paxton · 2026-07-21