Chollet: all AI converges to symbolic learning as 8-year paper finds implicit symbolic structure in LLMs
burny_tech · x · 2026-09-03
- François Chollet amplified a new paper from RTomMcCoy's team, the result of an 8-year project: while LLMs seem very different from symbolic systems, they excel in symbolic domains (language, code, math). The finding: LLM representations have implicit symbolic structure.
- Chollet's big-picture take: all AI will inevitably converge towards symbolic learning—modeling data by finding the shortest symbolic program that explains it—since that is the optimally efficient form of AI, though there can be multiple evolutionary paths to that destination.
- The paper provides empirical evidence of symbolic structure inside LLM representations, adding fresh data to the neural-vs-symbolic debate.
More from AGI Musings
- Consciousness Experts Clash in Nature Over Whether AI Could Ever Be Conscious — anilkseth · 2026-10-21
- Polymarket puts just 7% odds on OpenAI pausing AI training this year — Polymarket · 2026-10-21
- AI agents are overwhelming Gmail's spam filter, researcher warns — LuizaJarovsky · 2026-10-21
- Daniel Lemire: AI-generated papers are exposing academia's 'Profzi scheme' — lemire · 2026-10-21
- Universities block thesis downloads while each dissertation averages barely a handful of lifetime reads — generativist · 2026-10-21
- Berkeley wins Schmidt Sciences HAVI grant to decode whale and parrot communication with AI — begusgasper · 2026-10-21