Locomotion policy trained in under 30 seconds with zero-order policy gradient

breadli428 · x · 2026-10-26

A demo of training a locomotion policy in under half a minute using zero-order policy gradient. The author argues the speedup from first-order gradients with BPTT over zero-order PG is minor, and even more ignorable with a learned world model where samples are incredibly cheap.

Related event: Debate over world-model gradients: zero-order wins on speed(2 posts)→

Original post →

More from Embodied

Embodied channel →