VLA-Δ: Zhejiang University Adds Physical State Transition Supervision to VLA Models

OmniAI-ZJU · hf · 2026-10-16

The OmniAI group of Zhejiang University's ACES Lab proposes VLA-Δ, addressing the weakness of VLA models that map observations directly to demonstrated actions without supervising intermediate physical state changes, making them prone to overfitting observation-action correspondences.

The framework uses physical changes between current and future states as explicit learning targets, building a large-scale pretraining dataset with physical state-transition annotations covering task-relevant semantics and visual motion changes, giving more direct supervision for continuous action generation. At inference the model generates actions directly from current observations with no added inference cost. VLA-Δ is competitive with SOTA on LIBERO and RoboTwin and improves real-world transfer.

Original post →

More from Embodied

Embodied channel →