First real-world RL fine-tuning on a VLA: policy turns jerky after ~10 rollouts
DominiqueCAPaul · x · 2026-09-28
The author shares a first real-world RL token experiment on a VLA, activating the learned residual policy only for the critical insertion step. Initial RLT rollouts work decently, but after 10 rollouts with updates the policy becomes visibly jerky, as shown in the video. Suspected causes: exploration noise injection or insufficient regularization of the residual policy—though noise should have shown up in the first rollouts too. Switching the RLT network off and letting the unedited VLA take over restores smooth motion and clean actuator insertion.
More from Embodied
- YC-backed Ornadyne's flapping-wing drone was classified as a bird by Air Force detectors — import_jmr · 2026-11-16
- Uber starts offering Amazon's Zoox robotaxi rides in Las Vegas — Polymarket · 2026-11-16
- Ant Lingbo Embodied AI Challenge crowns TARS team after 48-hour real-robot hackathon — 新智元 · 2026-11-16
- Tesla FSD fleet tops 7 billion city miles, adding ~500M in under four weeks — XFreeze · 2026-11-16
- Ropedia Releases Xperience 2: 1,500+ Scanned Real-World Scenes Paired With Egocentric Demos — liuziwei7 · 2026-11-16
- Hangzhou's Manycore Tech launches Aholo MS07 3D laser scanner with CHCNAV — teortaxesTex · 2026-11-16