A fine-tuned MolmoAct2 policy gets an SO-101 robot to play a real xylophone
DJiafei · x · 2026-07-23
At a Rerun bounty, Team Lama won praise for a fine-tuned MolmoAct2 policy that can play a real xylophone with an SO-101 robot.
- The hard part is physical control: each strike has to ring the bar instead of damping it.
- The demo is visualized live in Rerun so you can see every hit.
- The team received $2K from the bounty pool.
- It is a neat example of robot learning where the challenge is not just motion, but precise contact dynamics.
More from Embodied
- AUAR's MicroFactory brings a deployable robotic wood-panel factory to the construction site — lukas_m_ziegler · 2026-09-11
- Musk: Cybercab certified at 165 Wh/mi, the most efficient production EV ever — elonmusk · 2026-09-11
- MKBHD goes hands-on with the first folding iPhone; $2,000 48MP selfie cam mocked — alexmacgregor__ · 2026-09-11
- NTU spin-off Ropedia launches HOMIE Gen 2 wearable system to train robots from human experience — liuziwei7 · 2026-09-11
- M.2-Oculink eGPU Link Silently Downgrades to PCIe Gen1 — Here's How to Check — El_90 · 2026-09-11
- Replit Agent in a robot builds and publishes websites autonomously via MCP — amasad · 2026-09-11