LeCun co-authors AD-E2E-JEPA: world model drives end-to-end without any driving policy
ylecun · x · 2026-09-30
A new paper (arXiv 2609.34085) by Haoran Zhu, Wancong Zhang, Yann LeCun and Anna Choromanska asks whether a world model can drive without training a driving policy.
- It systematically evaluates existing action-conditioned JEPA world models (LeWM, DINO-WM, JEPA-WM) for end-to-end autonomous driving, using a goal-conditioned zero-shot planning setup with ground-truth future observations as goals to isolate world-model quality from policy learning.
- Existing models trade off accuracy vs. compute: accurate models are expensive, efficient ones can't plan well.
- AD-E2E-JEPA adds a SIGReg-regularized learnable projector over projected patch embeddings, cutting planning patches 16x and embedding dimension 4x for a 100x inference speedup — 0.8s for an 8-frame rollout over 256 candidate trajectories.
- Without any trained policy, the world model alone reaches goals 20m away within 4.0/2.8m displacement using trajectory vocabularies. Paper and code are public.
More from Embodied
- YC-backed Ornadyne's flapping-wing drone was classified as a bird by Air Force detectors — import_jmr · 2026-11-16
- Uber starts offering Amazon's Zoox robotaxi rides in Las Vegas — Polymarket · 2026-11-16
- Ant Lingbo Embodied AI Challenge crowns TARS team after 48-hour real-robot hackathon — 新智元 · 2026-11-16
- Tesla FSD fleet tops 7 billion city miles, adding ~500M in under four weeks — XFreeze · 2026-11-16
- Ropedia Releases Xperience 2: 1,500+ Scanned Real-World Scenes Paired With Egocentric Demos — liuziwei7 · 2026-11-16
- Hangzhou's Manycore Tech launches Aholo MS07 3D laser scanner with CHCNAV — teortaxesTex · 2026-11-16