Why LLMs can invent genuinely new things: the role of verifiers
bindureddy · x · 2026-08-31
Bindu Reddy explains the technical reasons behind LLM innovation:
- Combinatorial Creativity: Hard problems are novel compositions of known blocks; models learn operators to explore unseen orders.
- Asymmetric Verification: Proposing is hard, checking is cheap. Massive test-time search with a verifier (e.g., Lean, FunSearch) filters for truth.
- Success Stories: AlphaProof (IMO Silver), FunSearch (new math), and AlphaFold (unseen proteins).
- Future: Biology and energy follow this pattern; mastering the universe's patterns could solve cancer and energy.
Related event: How LLMs Invent New Things: Search and Verification(4 posts)→
More from Research
- FBI method trains for Pass@K with one sample per update at 12.3% of the cost — EmtiyazKhan · 2026-10-16
- Berkeley researchers sample humanoid robot policies directly from weight space with diffusion — berkeley_ai · 2026-10-16
- OneWM: unified causal training shows world and action modeling improve each other — IAAI233 · 2026-10-16
- Baidu's Virtual Head Attention tames the KV cache, FLOPs, quality triangle in long-context LLMs — baidu · 2026-10-16
- 5.8M-param Speech Event Detector adds laughs, breaths and背景 sounds to Whisper transcripts — Ayush Kumar Bar · 2026-10-16
- Huawei's SUPRA-Tex turns one image into relightable 3D materials with WYSIWYG fidelity — Chen Yang · 2026-10-16