Pretraining perplexity is like golf: lower score is better

daniel_mac8 · x · 2026-11-23

A one-liner from Daniel Mac: measuring pretraining perplexity is like golf — the lower the score, the better. A handy sports analogy for understanding this common model metric.

Original post →

More from Fun

Fun channel →