MolmoAct2 Controls Robotic Arm Zero-Shot
DJiafei · x · 2026-07-10
MolmoAct2 is introduced as an action-inference model capable of running zero-shot on the SO-ARM101 robotic arm, emphasizing that it works out of the box "without any training."
It has now been integrated into LeRobot, covering the entire pipeline:
- Fine-tuning: Supports full-parameter or LoRA
- Evaluation: Provides a ready-to-use evaluation workflow
- Real-world deployment: Can be directly deployed onto physical robots
Technically, it combines the Molmo2-ER vision-language backbone with a flow-matching action expert, translating images, language, and embodiment states into action chunks. The post also details the hardware requirements: bf16 inference takes about 12GB of VRAM, LoRA fine-tuning can be done on a single 24GB GPU, and calibration corrections are already built into the checkpoint.
More from Embodied
- AUAR's MicroFactory brings a deployable robotic wood-panel factory to the construction site — lukas_m_ziegler · 2026-09-11
- Musk: Cybercab certified at 165 Wh/mi, the most efficient production EV ever — elonmusk · 2026-09-11
- MKBHD goes hands-on with the first folding iPhone; $2,000 48MP selfie cam mocked — alexmacgregor__ · 2026-09-11
- NTU spin-off Ropedia launches HOMIE Gen 2 wearable system to train robots from human experience — liuziwei7 · 2026-09-11
- M.2-Oculink eGPU Link Silently Downgrades to PCIe Gen1 — Here's How to Check — El_90 · 2026-09-11
- Replit Agent in a robot builds and publishes websites autonomously via MCP — amasad · 2026-09-11