EBM tutorial's master table maps GANs, diffusion, BERT, and RL into one framework

daibond_alpha · x · 2026-11-20

Part 3/5 of the EBM tutorial thread: classifiers, GANs, flows, diffusion, autoregressive LMs, SimCLR/CLIP/word2vec/BERT, EBM policies, world models, IRL, and planning are all EBMs differing mainly in partition-function and sampling handling. The post includes a master table detailing each method's energy form, inference, learning, and partition-function treatment (e.g., GANs need entropy regularization, flows have Z=1, RLHF's Z is absorbed by the policy/ref ratio).

Original post →

More from Research

Research channel →