LLMs as monotone compression: why Kolmogorov complexity hinges on one-way functions
mrdrozdov · x · 2026-10-10
Rafael Pass shares a thread arguing LLMs are essentially monotone compressors, and whether the 'monotone' assumption is necessary hinges on the existence of one-way functions — linking Kolmogorov complexity theory to how LLMs work.
More from AGI Musings
- Scientists brief EU's Virkkunen on agent swarm risks: alignment lagging capabilities — S_OhEigeartaigh · 2026-10-10
- Mathematician John Urschel solved a decades-old problem with GPT Astra, staying optimistic on AI research — soumitrashukla9 · 2026-10-10
- 'Association for Human Mathematics' bans AI via three vows, mocked as self-defeating — chrisfirst · 2026-10-10
- Liv Boeree: AI probably isn't sentient, but torturing it is still bad for you — HarperSCarroll · 2026-10-10
- Data centers could become SpaceX's biggest revenue stream, with $1T revenue on the horizon — Dr_Singularity · 2026-10-10
- Mathematicians stunned as OpenAI's Quasi-Riemann solutions rediscover their signature tricks — ctjlewis · 2026-10-10