LeCun's LeVJEPA cuts video training compute by up to 20.8x
TheTuringPost · x · 2026-08-30
Yann LeCun's team introduces LeVJEPA, a method designed to make video pretraining cheaper and simpler by using a single encoder and a small projector. It employs an invariance loss on global and local video views, regularized by SIGReg to prevent representation collapse without architectural asymmetries. By randomly dropping 95% of video patches and using causal attention, LeVJEPA achieves performance matching or surpassing V-JEPA 2 while using 5.6 to 20.8x less compute at matched epochs.
Related event: LeCun Team Releases LeVJEPA: Up to 20x Cheaper Video Pretraining(6 posts)→
More from Research
- Google Paper: Autonomous AI Research Hallucinates 90% Without Checks — rohanpaul_ai · 2026-09-01
- RLHF impact on tokens: unconscious shifts vs conscious choices — voooooogel · 2026-09-01
- On token layers and consciousness in RLHF — voooooogel · 2026-09-01
- CommerceAgentBench released: Qwen leads open-weight models — Alibaba_Qwen · 2026-09-01
- Discussion on Why Universal Time Series Models Work — Afinetheorem · 2026-09-01
- New paper: a structured ladder for scaling large reasoning models beyond human supervision — Zhiqin Yang · 2026-09-01