MolmoSpaces benchmark launched: GPT-Astra beats all open-source VLA baselines zero-shot
notmahi · x · 2026-09-15
The Molmo team released MolmoSpaces-v1, a benchmark for robotic spatial understanding, asking whether robotics is having its "GPT moment."
Key result: GPT-Astra outperformed all open-source VLA/world-model baselines on a zero-shot subset of the benchmark. The authors published execution traces and argue general-purpose models are showing a leap in spatial reasoning for robotics.
More from Embodied
- Open-source companion robot Lamp starts shipping to 20+ countries at $969 — dee_hw · 2026-10-30
- SCAMPER demo: virtual rat trots and gallops with gaits it never saw in training — tyrell_turing · 2026-10-30
- DIY humanoid build, day 7: creator gives up fixing physics, adds 1-DOF ankles — _Stocko_ · 2026-10-30
- Lambda Surgical launches first-in-human study of LiDAR-based LambdaGuide at PINE — ditzikow · 2026-10-30
- Gaussian splats double as shared GPS: one city map localizes drones, robots and phones — bilawalsidhu · 2026-10-30
- SimReady dataset offers 2,677 simulation-ready 3D assets to build virtual test worlds — victormustar · 2026-10-30