Language Is a Lossy Compression of Reality
A viral argument holds that language is a slow, lossy social compression of reality, with speech carrying only tens of bits per second—less than a 56k modem—meaning models train on lossy residues while 99.9% of the universe's data goes unused.
2026-09-27 ~ 2026-09-28 · 2 related posts
- Language is a lossy compression: even the best models train on a thin residue of reality — yunta_tsai · 2026-09-27
- Training data is a lossy residue of the world — over 99.9% of it untouched — zeroxjackson · 2026-09-28