SLA scales spatial-language-action models via continual pre-training with frozen 3D alignment

HKUSTGZ · hf · 2026-11-06

HKUST(GZ), BAAI, Tsinghua and others present SLA, a Spatial-Language-Action model that scales implicit spatial alignment via continual pre-training. Initialized from a pretrained π0.5 policy, it aligns intermediate visual embeddings with spatial representations from a frozen 3D perception model, uses feature-dependent gates to aggregate multi-layer VLA features, exploits partially available depth and camera calibration with RGB, and applies probabilistic state dropout to encourage visual reliance. All auxiliary components are training-only, so the inference architecture is unchanged; heterogeneous robot datasets are unified for diverse embodiments, tasks, and scenes.

Original post →

More from Embodied

Embodied channel →