AlphaNIST robot training: Newton physics plus sparse reward did the heavy lifting

milesmacklin · x · 2026-10-14

mateoguaman details the improvements from SGS to AlphaNIST: switching from PhysX to Newton for a massive performance boost, better reset distributions, robot controller parameters, observations and network architecture, and a unified multi-task formulation. Surprisingly, these stacked improvements enabled training with a minimal reward function—four general terms with most gradient signal from a sparse task reward, and a single coefficient tuning the entire cost term.

Original post →

More from Embodied

Embodied channel →