Language is a latent space for world knowledge, at the cost of information loss
docmilanfar · x · 2026-10-13
Google researcher Peyman Milanfar offers a compact framing: language functions as a latent space of world knowledge, optimized for model tractability at the cost of inevitable information loss during encoding and decoding.
More from AGI Musings
- Yacine: all software is trash, so with AI it's now reasonable to just build it yourself — yacineMTB · 2026-10-13
- Self-replicating AI skeptics: it runs in datacenters, not your laptop — yacineMTB · 2026-10-13
- Can AI explain medical uncertainty without panicking patients? — yi111 · 2026-10-13
- Filtering the Singularity: why low-frequency trends now matter more than any single AI breakthrough — akbirthko · 2026-10-13
- Embedded evaluators can't fix companies that choose to be bad, Stella Biderman argues — BlancheMinerva · 2026-10-13
- Alignment is stuck because it lacks MNIST-style benchmarks, researcher argues — joshua_saxe · 2026-10-13