New MolmoSpaces-CommonSense benchmark: no robot policy tops 30% on manipulation tasks

RanjayKrishna · x · 2026-10-31

Researchers behind Molmo introduce MolmoSpaces-CommonSense, a benchmark testing commonsense reasoning in robot manipulation. Today's policies look great on existing benchmarks but collapse when a mug is hidden behind objects or a hot pan is requested. Results: none of the tested policies topped 30% on any task, exposing a major gap in occlusion reasoning and physical commonsense for manipulation models.

Original post →

More from Embodied

Embodied channel →