LeCun team proves Platonic Representation Hypothesis: good views beat scale by 42x

galilai-group · hf · 2026-10-30

Randall Balestriero and Yann LeCun (Brown/NYU/AMI Labs) turn the Platonic Representation Hypothesis into a theorem: separately trained JEPAs converge to shared representations when positive pairs are two views of one scene, while next-token prediction acts as a JEPA with bad views. Good views need 42x fewer training samples for the same alignment, and a 109M-parameter text JEPA aligns with DINOv2 and CLIP image encoders better than LLMs up to 72B—plus one rotation turns encoders into an image captioner (CIDEr .838 on COCO). Positive view design, not scale, is the lever.

Related event: Platonic Representation Hypothesis Proved as Theorem with JEPAs; 109M Model Beats 72B LLM(12 posts)→

Original post →

More from Multimodal

Multimodal channel →