LeVJEPA: Efficient Video Pretraining Without Heuristics, 20x Less Compute, Beats Baselines
iScienceLuvr · x · 2026-08-28
Researchers introduce LeVJEPA, the first video encoder trained under LeJEPA's collapse-free objective. At matched epochs on identical data, LeVJEPA matches or surpasses V-JEPA 2 across ViT-S/B/L with 5.6-20.8x less pretraining compute. At matched total FLOPs, it exceeds the strongest video baseline by 7.6 points on ImageNet-1K while remaining competitive on motion-centric benchmarks. Against compute-matched DINOv2, it approaches image-pretrained encoder on appearance-centric evaluation while nearly doubling motion-centric accuracy.
Related event: LeCun Team Releases LeVJEPA: Up to 20x Cheaper Video Pretraining(6 posts)→
More from Research
- New paper: agents must "forget" to keep improving in days-long autoresearch runs — matei_zaharia · 2026-10-16
- Ex-OpenAI interpretability lead: most neurons in trillion-parameter models are now legible — burny_tech · 2026-10-16
- SHELDON harness models separate hypothesis and observation spaces for scientific agents — shi_weiyan · 2026-10-16
- WEDGE turns navigation agents' own failures into targeted training worlds — mohitban47 · 2026-10-16
- Researchers propose publicly logging OpenReview desk rejections with submission bans — ChenhaoTan · 2026-10-16
- MIT's Buehler on AI as a new language of science: superintelligent partners and executable papers — CatAstro_Piyush · 2026-10-16