Fully open MolmoAct 2 tops independent robotics benchmark LIBERO-MAX on dynamic robustness
DJiafei · x · 2026-09-30
AI2's fully open robotics model MolmoAct 2, after task-specific fine-tuning, takes the top spot for overall task success on the independent Reality Check benchmark.
The new LIBERO-MAX benchmark tests dynamic robustness: a single environment change is introduced after the robot has begun acting — object/receptacle relocation, camera shift, sensor corruption, lighting or visual theme switch, distractor burst, or obstacle insertion — 1,000 matched cases per event type. Each Dynamic rollout is matched to a Base control with the same task, seed, and executed prefix, isolating the effect of the change. It measures whether task success is preserved, not whether the policy internally detects or deliberately replans.
The author cites Nicolas Keller's evaluation showing MolmoAct 2 still generalizes gracefully under these mid-episode perturbations.
More from Embodied
- YC-backed Ornadyne's flapping-wing drone was classified as a bird by Air Force detectors — import_jmr · 2026-11-16
- Uber starts offering Amazon's Zoox robotaxi rides in Las Vegas — Polymarket · 2026-11-16
- Ant Lingbo Embodied AI Challenge crowns TARS team after 48-hour real-robot hackathon — 新智元 · 2026-11-16
- Tesla FSD fleet tops 7 billion city miles, adding ~500M in under four weeks — XFreeze · 2026-11-16
- Ropedia Releases Xperience 2: 1,500+ Scanned Real-World Scenes Paired With Egocentric Demos — liuziwei7 · 2026-11-16
- Hangzhou's Manycore Tech launches Aholo MS07 3D laser scanner with CHCNAV — teortaxesTex · 2026-11-16