DeepMind Paper: LLMs Lack the 'Intuitive Leap' for Scientific Discovery
Google DeepMind researcher Tom Zahavy presented a position paper at ICML 2026 titled 'LLMs Can't Jump,' arguing that while current large language models (LLMs) excel at data compression and logical deduction, they cannot perform the crucial 'intuitive leap' in scientific discovery—the non-logical jump from empirical data to abstract axioms. The paper uses Einstein's development of general relativity as an example of a breakthrough requiring such a leap beyond existing data. Zahavy later clarified that this is a personal position paper, not an official DeepMind stance, and does not claim LLMs will never contribute to scientific discovery; leading labs and academia are already using LLMs to advance real science.
Confirmed
- The paper breaks down scientific discovery into three steps: encountering empirical data, making a non-logical 'intuitive leap' to propose abstract axioms, and then rigorous logical deduction.
- It argues that current LLMs are good at combinatorial tasks and logical deduction but have structural limitations in areas requiring human conceptual priors, failing to perform the key 'intuitive leap' in scientific discovery.
- The paper uses Einstein's general relativity as an example of a fundamental breakthrough requiring an axiomatic leap beyond existing data.
- Tom Zahavy explicitly clarified that this is a personal position paper, not an official DeepMind statement, nor a claim that LLMs will never make scientific discoveries. He emphasized that leading labs and academia are already using LLMs to drive real scientific progress.
Why it matters
- This research directly addresses a core controversy in AI: whether scaling model size and data volume is sufficient to achieve artificial general intelligence (AGI).
- Commentators like Peter Berezin argue that if LLMs cannot bridge the gap of conceptual innovation, the current technical path may be a dead end for superintelligence.
- The study provides a new perspective for evaluating the true capabilities of LLMs, clarifying the boundaries and challenges of current AI technology in fundamental scientific innovation.
2026-07-28 ~ 2026-07-29 · 7 related posts
Primary sources
- Google DeepMind says LLMs can prove theorems but still cannot make scientific “jumps” — kylekabasares · 2026-07-28
- What Can Current LLMs Solve? DeepMind Research Maps Capability Boundaries — burny_tech · 2026-07-28
- [source] Einstein’s three-step view of discovery says AI still lacks the intuition jump — TZahavy · 2026-07-28
- Peter Berezin says LLMs may be a dead end to superintelligence — GaryMarcus · 2026-07-29
- [source] DeepMind paper says LLMs need abductive reasoning, not just compression or proofs — burkov · 2026-07-29
- [source] DeepMind researcher says his “LLMs Can’t Jump” paper is about Einstein-style leaps, not AI dead ends — TZahavy · 2026-07-29
- DeepMind says LLMs still can’t make scientific leaps, and Tao warns of proof overproduction — APPSO · 2026-07-29