LLMs May Lack the Ability for "Leap" Discoveries
burny_tech · x · 2026-07-10
This repost discusses a cognitive control perspective: LLMs act more like bottom-up salience machines, rather than top-down regulatory systems capable of task-irrelevant transfer like humans.
The cited content further breaks down "discovery" into three capabilities:
- induce: Inducting from data, yielding at best Newtonian-style explanations with correction terms
- deduce: Strictly deriving based on existing axioms, but generating no new axioms
- jump: Inventing new frameworks, such as proposing "spacetime curvature"
The core argument is that even if an LLM were fed all papers, data, and formulas prior to 1905, it might not achieve the "leap" discovery that Einstein did, because that step goes beyond both induction and deduction.
Related event: Opinions Suggest LLMs Lack Capacity for Scientific Leaps(3 posts)→
More from AGI Musings
- Superintelligence will be maximum good, not stupid or evil, argues Patterson — davidpattersonx · 2026-09-11
- Mathematician Daniel Litt Launches Problem Repo to Track Human vs AI Progress: 15 Problems, 1 Solved — littmath · 2026-09-11
- Should AI models be taught morality? Breakout incidents expose missing ethical training — Pfungus_ · 2026-09-11
- SoftBank's Masayoshi Son predicts 100 trillion self-replicating AIs: "humans' era as top life form is ending" — Puzzleheaded-King584 · 2026-09-11
- We are witnessing the unreasonable effectiveness of inference-time scaling — sqcai · 2026-09-11
- The AlphaFold lesson: AI-solved math may mean fewer mathematicians needed — kiki-le-koala · 2026-09-11