LeCun's new paper: JEPA world models answer "what if" with no retraining

TheTuringPost · x · 2026-11-21

Randall Balestriero, Yann LeCun and co-authors released Counterfactual World Models: JEPAs That Reason About "What If". The core claim: world models trained only on factual transitions provably cannot answer counterfactual questions on their own. But for most physical systems, the counterfactual outcome is, to first order, the observed outcome plus the difference between the model's predictions under the alternative vs. factual action — so no counterfactual data, extra parameters, or retraining is needed.

Validated from pixels with frozen encoders (DINOv2, MAE):

Theory includes an O(h²) error bound, a matching minimax lower bound, and failure conditions at discontinuities. Practical payoff: separating bad decisions from bad luck when debugging robots. Code and demo are available.

Related event: LeCun and Colleagues Release Counterfactual World Models Paper(12 posts)→

Original post →

More from Research

Research channel →