Today's LLM Strengths and Weaknesses Trace Back to Component Ideas
KordingLab · x · 2026-08-26
UPenn's Kording Lab argues that a great deal of the strengths and weaknesses of today's LLMs can be understood from a set of component ideas. In a follow-up, the thread concludes: the Old Recipe was extended with 'inner speech' + tools + agents + better evaluation, producing today's interactively 'thinking' machines.
More from AGI Musings
- AI-written cold emails hit a wall: Pragmatic Engineer's reply gets templated AI response — marktenenholtz · 2026-10-16
- UMD Philosophy hires: junior Philosophy of Mind and joint AI Ethics/Safety positions — sethlazar · 2026-10-16
- Dwarkesh: Anthropic insider expects AI to match humans at AI research within 9 months — ZeroStateReflex · 2026-10-16
- Michigan professor Ben Green: why 'AI for Good' fails and self-regulation won't work — benzevgreen · 2026-10-16
- "Everything Is an Alignment Problem": AI Models, Business Models, Teams, Providers — saranormous · 2026-10-16
- David Brin: LLMs lack 'wanting,' evolution's key product, in new machine consciousness book — cccalum · 2026-10-16