AI systems are just compression and sampling — no physical reality in strings
gerardsans · x · 2026-10-17
Gerard Sans pushes back on what he calls a recurring narrative in the AI community, offering a mechanistic account of how these systems work:
- AI processes data through compression (encoding) and sampling (decoding); the data is mostly plain text.
- Strings and pixels contain no physical reality — only "statistical fossils" left by compression: regularities arising from frequency and co-occurrence.
- He argues that understanding how these mathematical objects are built and applied is sufficient, and that people seek metaphysical explanations simply because they haven't studied how the systems actually work.
Related event: AI Systems Are Just Compression and Sampling, Developer Argues(2 posts)→
More from AGI Musings
- Ion Stoica at Stanford: humans specify and verify, models design and generate — RajaXg · 2026-10-17
- AI Engineers Who Can Deploy AI to Solve Real Business Problems Will Be Insanely Valuable — mdancho84 · 2026-10-17
- Redditor argues AI's endgame is either feudalism or socialism via UBI — AdCareless8817 · 2026-10-17
- AI containment bingo v2: meme updated with sourced evidence tags — AIGODSEND · 2026-10-17
- Thom Wolf on avoiding brain rot: Socratic AI questioning beats asking for answers — TheZachMueller · 2026-10-17
- MIT professor proposes "living scientific records" for decentralized multi-agent discovery — ProfBuehlerMIT · 2026-10-17