Discrete robot policies match or beat continuous action heads, challenging common belief

siddkaramcheti · x · 2026-10-22

New research challenges the belief that robot policies need continuous action heads: policies with the simplest discrete representations match or beat continuous ones across sim and real, single-step and diffusion/flow settings. Co-author maxsimchowitz frames it as a broader lesson on modality representation—discrete parametrizations learn geometry from data without being constrained by it, "exactly what the bitter lesson tells us to look for."

Related event: Study: Simple Discrete Action Representations Match or Beat Continuous Heads in Robot Policies(4 posts)→

Original post →

More from Embodied

Embodied channel →