"What distillation cannot teach me, I will learn by recursive self improvement"

attentionmech · x · 2026-11-18

A short but widely shared quip riffing on the classic Feynman-style saying: "What I cannot learn via distillation, I will learn by recursive self improvement."

It fuses two training concepts — distillation and RSI — into one line, capturing the current tension between compression-by-distillation and open-ended self-improvement routes toward AGI.

Original post →

More from Fun

Fun channel →