D&A turns any VLM into a zero-shot robot reward model, hitting SOTA on 3 benchmarks

KyleMorgenstein · x · 2026-11-04

Researchers introduce D&A (Decoupling description & assessment), which improves GPT, Gemini, Claude and Qwen VLMs as zero-shot robot reward models with no training. Feeding a video of any robot task plus a text description yields an off-the-shelf reward model, enabling zero-shot RL and filtered IL, improving code-as-policies via rich language feedback, and achieving SOTA on three benchmarks. Demo shows D&A only grants extra reward when the goal is visible in the image.

Related event: D&A Turns Any VLM into a Zero-Training Robot Reward Model(4 posts)→

Original post →

More from Embodied

Embodied channel →