Standard JEPAs provably can't answer counterfactuals, however much data they get
TheTuringPost · x · 2026-11-21
From TheTuringPost's thread, explaining the blind spot the new paper targets: picture a boat pushed by a hidden current—before acting, a world model can only predict the average outcome, and only the real result reveals what the current did. Ask a standard JEPA "what if I'd steered differently?" and it returns the average again. The paper proves a model trained only on factual transitions cannot answer this on its own, whatever its data or capacity—the gap counterfactual world models are built to close. The attached figure shows the model's estimated counterfactual trajectories against the true counterfactual in the boat experiment.
Related event: LeCun and Colleagues Release Counterfactual World Models Paper(12 posts)→
More from Research
- Riemann hypothesis 'proven by Turkish mathematician using AI' claim mocked as the 'Organic Turk' — CatAstro_Piyush · 2026-11-22
- Andriy Burkov releases The Hundred-Page Language Models Book, hands-on with PyTorch — burkov · 2026-11-22
- Generative AI meets cardiology: Dagstuhl seminar bridges ML and clinical practice — StephanMandt · 2026-11-22
- SubRoformer hits SOTA music source separation with DSP subband filters — affige_yang · 2026-11-22
- Emily Riehl releases Lean game teaching dependent type theory at intro-to-proofs level — abhi9u · 2026-11-22
- Curated reading list: evaluating mobile-use agents on Android, from AppAgent to AndroidReality — East-Muffin-6472 · 2026-11-22