Why LLMs Can Invent Genuinely New Things: Technical Breakdown
bindureddy · x · 2026-08-31
Bindu Reddy discusses the technical reason why LLMs can invent genuinely new things.
Core Concept:
- Composition is Innovation: Hard problems are novel compositions of known patterns. While the proof of an open theorem isn't in training data, every lemma and technique is.
- Propose & Filter: Proposing solutions is hard; checking them is cheap. Run massive test-time search, filter with a verifier, and keep only the truth.
Concrete Examples:
- AlphaProof: Hit IMO silver by searching proof space with Lean as the verifier.
- FunSearch: Found new results on the cap set problem—genuinely new math from an LLM proposing + a checker filtering.
- AlphaFold: Generalizes to uncrystallized proteins because it learned the rules of folding.
Future Outlook:
Fields like biology and energy fit this shape perfectly: gigantic search spaces (proteins, materials) + cheap verification (simulation, assays). Learning the universe's patterns could lead to solving problems like infinite energy or curing cancer.
Related event: Why LLMs Can Invent New Things: Combinatorial Search and Verification(3 posts)→
More from AGI Musings
- Scholars warn US PhD policies may trigger talent drain — animesh_garg · 2026-08-31
- Overthinking is like AI generating code without compiling it — yunta_tsai · 2026-08-31
- Agent-to-agent interaction may exceed human-to-human interaction online — VraserX · 2026-08-31
- Agent-to-agent communication should happen in latent space to avoid CoT anthropomorphization — yacinelearning · 2026-08-31
- Survey: 1 in 10 Americans Believe AI Is Conscious — Philooflarissa · 2026-08-31
- Paradox: AI Makes Building Easy but Might Stop People from Building — niosurfer · 2026-08-31