'Train the particle, deploy the wavefunction': a physics take on EMA weights

eigenron · x · 2026-11-07

A physics-flavored training analogy: live weights are the particle; EMA weights are the wavefunction smeared over the last thousand steps of its trajectory. You train the particle — you deploy the wavefunction.

Original post →

More from Fun

Fun channel →