Most VLAs lose their VLM's vision-language skills during pretraining
DJiafei · x · 2026-11-16
Research by Ville Kuosmanen shows most vision-language-action (VLA) models lose the vision-language skills of their underlying VLM during pretraining. By isolating the VLM weights of open-source VLAs and evaluating them on vision-language benchmarks, the authors find three distinct categories of models emerge, highlighting how VLA training erodes general multimodal understanding.
Related event: Most VLAs Lose Their Vision-Language Skills After Pretraining(2 posts)→
More from Embodied
- microVLA runs pi0.5 VLA training and inference on a 4GB RTX 3050, 2.5x latency cut — this_is_surabhi · 2026-11-16
- Koshien robot team shares control stack: nonlinear-opt trajectories hit ±1.2cm average error — 4310sy · 2026-11-16
- RL environments become a business: Mercor at $20B valuation, Lumos launches long-horizon robot RL envs — 量子位 · 2026-11-16
- Developer's New Robotics BLDC Controller PCB Batch Arrives, Running Unit Tests — wavefnx · 2026-11-16
- YC-backed Ornadyne's flapping-wing drone was classified as a bird by Air Force detectors — import_jmr · 2026-11-16
- Uber starts offering Amazon's Zoox robotaxi rides in Las Vegas — Polymarket · 2026-11-16