V-JEPA-LM: counterfactual supervision teaches LMs to read video dynamics with 20x less data

Keuntae Kim · hf · 2026-11-16

V-JEPA-LM shows that counterfactual supervision over pixel transformations — the same clip played forward vs. backward, where only the change determines the answer — lets language models read motion dynamics from a frozen V-JEPA predictive video encoder instead of static, text-aligned features.

Original post →

More from Multimodal

Multimodal channel →