VLA-REPLICA benchmark accepted at NeurIPS 2026, adds MolmoAct 2 and GR00T N1.7
YuXiang_IRVL · x · 2026-09-27
VLA-REPLICA accepted to NeurIPS 2026 E&D Track
- What it is: a low-cost, reproducible real-world benchmark for evaluating VLA models, addressing the lack of standardized evaluation.
- How: standardized hardware setup and scene initialization make it easily reproducible across labs and institutions.
- Updates: leaderboard now includes MolmoAct 2 and GR00T N1.7; all models evaluated over 3 rounds in both ID and OOD settings with error intervals.
More from Embodied
- Developer's New Robotics BLDC Controller PCB Batch Arrives, Running Unit Tests — wavefnx · 2026-11-16
- YC-backed Ornadyne's flapping-wing drone was classified as a bird by Air Force detectors — import_jmr · 2026-11-16
- Uber starts offering Amazon's Zoox robotaxi rides in Las Vegas — Polymarket · 2026-11-16
- Ant Lingbo Embodied AI Challenge crowns TARS team after 48-hour real-robot hackathon — 新智元 · 2026-11-16
- Tesla FSD fleet tops 7 billion city miles, adding ~500M in under four weeks — XFreeze · 2026-11-16
- Ropedia Releases Xperience 2: 1,500+ Scanned Real-World Scenes Paired With Egocentric Demos — liuziwei7 · 2026-11-16