LeCun and researchers debate JEPA: don't confuse foundational research with downstream scaling
DrMorganLevine · x · 2026-11-08
A discussion on JEPA research directions. Haiyu Wu argues not to confuse upstream foundational research on methods with downstream scaling, engineering, model-building, and products, calling JEPA one of the best research directions: SIGReg/VISReg is simple to implement and experiments are small-scale, but the questions are fundamental—why it works, its real weaknesses, and whether a general cross-domain fix exists.
Yann LeCun adds taxonomy: image/video SSL methods differ by use of reconstruction, presence of a predictor (JEA vs JEPA), anti-collapse methods, and data augmentation. DINO is technically a JEA, distinguished by contrastive-clustering-based anti-collapse (stopgradient/EMA) and task-specific image-transform augmentation. V-JEPA 2.1, like DINO, comes from Meta-FAIR with engineering teams, large proprietary datasets, and substantial compute.
Related event: LeCun Clarifies JEPA vs DINO in Long Post Amid Research Route Debate(3 posts)→
More from Models
- User accuses Anthropic of silent quantization "psyop," says it erodes trust across AI field — ryunuck · 2026-11-09
- Researcher Says Anthropic's Bio Safety Filter Blocks Codebase Reasoning, Causing ICLR Errors — josephdviviano · 2026-11-09
- Dev: with latest-gen LLMs he stops overspecifying and lets the model riff — jongranskog · 2026-11-09
- Google quietly reversed its privacy pledge: consumer Gemini now routes Gmail/Drive data to human review — tlislo · 2026-11-08
- Pro User: Gemini Broke a Month-Old Project Overnight, Burned 3 Hours of Credits Fixing It — FillerKill · 2026-11-08
- Locally-run Qwen hallucinates a realistic provider API error out of thin air — little_raven_black · 2026-11-08