Robo-ValueRL rates actions by estimated task progress to learn from messy robot data

burkov · x · 2026-11-18

Robo-ValueRL tackles a data-quality problem in robots trained from demonstrations and real-world experience: the data mixes successful actions with hesitation, mistakes, and failed attempts, and treating every action equally limits offline learning and destabilizes online updates.

Key points:

The framework also measures value-estimate uncertainty (text truncated in source), aiming to make better use of mixed-quality robot experience.

Original post →

More from Embodied

Embodied channel →