JEM trained in 20 H100-hours lands 1 point behind fine-tuned DINOv3

gabriberton · x · 2026-11-16

Researcher Simon Goodman shared results from training JEM (built on LeJEPA) for 100 epochs: using only 20 H100 hours on 250k images, it landed just 1 point behind a fine-tuned DINOv3, and he believes more training could beat it. The main issue is rare classes, likely a sampling problem. Resharing it, gabriberton praised the style: run simple experiments and share findings immediately—no novelty-seeking, no 50-page papers, no review queues.

Original post →

More from Research

Research channel →