JEPA is just a new name for old tricks: iBOT, data2vec and even CPC were basically I-JEPA
TimDarcet · x · 2026-11-10
- Responding to the claim that JEPA is "the only new idea in the SSL space in the past 3 years," Tim Darcet argues it's a new term for old methods: iBOT, data2vec, and even earlier CPC were essentially I-JEPA.
- The exchange debates what genuine innovation self-supervised learning has seen recently, touching on the historical positioning of LeCun's JEPA line of work at Meta.
More from Research
- Terence Tao says AI Navier–Stokes proof is correct but mathematicians 'learned almost nothing' — sudoraohacker · 2026-11-10
- Berkeley's Flip Anything: coding agent self-learns robot flip policies from 24.7% to 95% success — k7agar · 2026-11-10
- Must-read papers of the week: VFlash, GR00T 2, agent guardrails, AI-scientist benchmarks — TheTuringPost · 2026-11-10
- Hugging Face open-sources 14.8B DNA model Carbon-X, second only to GPT-6.1 Sol on GenomeQA — LoubnaBenAllal1 · 2026-11-10
- Agent swarm experiment: prompt name order and model choice decide who leads — bibryam · 2026-11-10
- New preprint frames Bayesian experimental design under misspecification as a max-min game — canaesseth · 2026-11-10