Microduck RL Training Library Open Source: Head Tracking and Backlash Simulation Tricks

Thom_Wolf · x · 2026-08-28

Pollen Robotics released the reinforcement learning training library microduckrl for the bipedal robot Microduck. Built on MuJoCo Warp with PPO, the project includes the full sim2real recipe, covering BAM actuator physics, domain randomization, and backlash simulation. The AGENTS.md document shares concrete reward design insights, such as using EMA to smooth head tracking error (to prevent oscillation caused by the head being 38% of the weight) and modeling motor backlash by adding an unactuated hinge in series with the motor.

Related event: Pollen Robotics Open-Sources RL Training Stack for Microduck Robot(3 posts)→

Original post →

More from Embodied

Embodied channel →