SJTU's VaM lets robots learn online from mistakes, 95%+ success over 4-hour autonomous runs

chris_j_paxton · x · 2026-10-26

Shanghai Jiao Tong University introduces Value as Memory (VaM), an online value-guided post-training framework for general robot policies. Recent value predictions are cached as task-progress memory alongside visual and proprioceptive observations, letting policies distinguish visually similar states (lost contact vs. successful re-grasp) and recover from mistakes. Training spans four offline-to-online stages, reusing demonstrations, off-policy human corrections, and on-policy rollouts with concurrent data collection and updates. VaM achieves 95%+ task success over 4 hours of continuous autonomous box assembly, also validated on laundry folding and magnetic bus assembly. Paper, code, and project page are public.

Original post →

More from Embodied

Embodied channel →