LeCun: EBMs are more general than probabilistic models, not a special case

ylecun · x · 2026-11-21

Yann LeCun corrects a common misconception: energy-based models (EBMs) are often presented as a particular form of probabilistic models, but they are actually more general.

Probabilistic models are a special case of EBMs where: (1) energies can be turned into probabilities via a Gibbs distribution — requiring a convergent, computable partition function; and (2) the loss has a probabilistic interpretation, e.g. negative likelihood.

There is a whole world of non-probabilistic EBMs that need no partition function or normalization and can be trained with many losses that have no probabilistic meaning.

Original post →

More from Research

Research channel →