Current LLM scaling doesn’t rule out future breakthroughs
JacquesThibs · x · 2026-07-20
The reply argues that even if current LLMs keep improving through scaling, that does not rule out other kinds of breakthroughs.
It expects humans may still discover many mathematical ideas that were missed due to limited search or cross-domain interpolation, and separately predicts there could be architectural or post-LLM breakthroughs beyond the current paradigm.
Related event: Debate Sparks on LLM's Potential to Generate New Theories(2 posts)→
More from AGI Musings
- Apollo chief economist: AI has delivered zero financial payoff outside Big Tech — rseroter · 2026-10-27
- OpenAI acquires Orchestra Bio to bring clinical-trial monitoring agents into drug development — dl_weekly · 2026-10-27
- Do AI agents work better when they pace themselves and take breaks? — EpistemicHope · 2026-10-27
- Experts Clash: Today's Models Dwarf GPT-4, But Journal Delays Lock Out New LLMs — DeryaTR_ · 2026-10-27
- Why would breaks help a transformer? Questioning the AI pacing hypothesis — EpistemicHope · 2026-10-27
- Venkatesh Rao essay: On Learning to Ride Your Brain — jger15 · 2026-10-27