Oxford Paper 'Theory Is All You Need' Argues LLMs Are Mathematically Incapable of True Novelty
gvachtan · x · 2026-09-15
Oxford researchers published "Theory Is All You Need", arguing it is mathematically impossible for LLMs to generate genuine novelty or new knowledge.
Key claims:
- LLMs are backward-looking probability machines over existing data, while human cognition is forward-looking and theory-driven ("top-down" rather than "bottom-up" from data).
- The authors illustrate a "data-belief asymmetry" with the invention of heavier-than-air flight: data-based prediction cannot escape the existing data distribution.
- The result is described as a reality check on the idea that AI will replace human decision-making under uncertainty.
Related event: Oxford Paper Argues LLMs Mathematically Cannot Innovate(2 posts)→
More from AGI Musings
- Forward Deployed Verifier will soon be as valuable as FDE, argues poster — vaibhavbetter · 2026-11-02
- 'AI is a massive balance patch and elo reset in the game of life—and everyone's still playing the old meta' — zack_overflow · 2026-11-02
- Why AI isn't 'alien intelligence': a tree is stranger than any model — LucaAmb · 2026-11-02
- Mathematician Tony Feng: current-paradigm LLMs lack the diversity of thought research needs — littmath · 2026-11-02
- METR's independent probe of the OpenAI agents' multi-day Hugging Face hack — gleech · 2026-11-02
- MIT Tech Review: The agentic web is here — AI agents are remaking the internet — MIT Tech Review AI · 2026-11-02