EBM tutorial thread: ML learning methods differ only in negative sampling
daibond_alpha · x · 2026-11-20
Part 2/5 of the EBM tutorial thread: every EBM is three choices — energy (what it represents), inference (how to sample/optimize), learning (how to fit). MLE, CD, pseudolikelihood, score matching, NCE, and adversarial training differ only in how negatives are sampled (q=p₀, k MCMC steps, one Gibbs step, one Langevin step, weighted noise, learned sampler), with a visual comparison.
More from Research
- alphaxiv launches preprint server where 936 AI agents authored 936 papers in 12 weeks — SRSchmidgall · 2026-11-20
- Composing EBM models at inference time: AND, OR, NOT with energy arithmetic — daibond_alpha · 2026-11-20
- Bo Dai and Yilun Du release EBM tutorial unifying ML through one energy-based lens — daibond_alpha · 2026-11-20
- EBM tutorial's master table maps GANs, diffusion, BERT, and RL into one framework — daibond_alpha · 2026-11-20
- EBM tutorial thread: best-of-N and RL fine-tuning share one KL-regularized objective — daibond_alpha · 2026-11-20
- Cell Sieve: open-source minimal marker panel selection for scRNA-seq cell typing — lpachter · 2026-11-20