NVIDIA's VeriFine Co-Evolves Policies and Judges for Self-Improving Embodied AI

drmapavone · x · 2026-10-20

NVIDIA researchers with UCLA, UC Berkeley and Stanford (including Marco Pavone) introduce VeriFine, an agentic harness for continuous self-improvement in Physical AI where policies, training curricula, and judges evolve together. As policies improve and develop new failure modes, static judges become a bottleneck—especially in embodied settings needing spatial grounding, causal reasoning, and safety awareness. VeriFine identifies policy failures, converts them into training signals, and when the judge itself bottlenecks progress, brings in targeted human feedback to refine its evaluations. Reported results: after three alternating judge/policy loops, policy reasoning score rises from 60.56 to 71.61 and judge-human Pearson correlation from 0.53 to 0.82 across autonomous driving and robot navigation tasks.

Original post →

More from Embodied

Embodied channel →