Gary Marcus says modern math AIs are hybrids, not pure LLMs
GaryMarcus · x · 2026-07-21
Gary Marcus says the latest attacks on him often miss the technical details, and highlights a key distinction in modern math AI.
- He agrees that hybrid systems have moved the field forward.
- The quoted argument says raw LLMs still suffer from compounding hallucinations on hard math.
- The proposed recipe for progress is a stack of SFT on reasoning traces, RL with process rewards, inference-time search such as MCTS, and executable tools.
- The broader point: today’s stronger math systems are hybrids, not pure transformers.
More from AGI Musings
- AI may make digital work infinitely leveraged while offline life gets more human — illscience · 2026-07-22
- Better AI math could save researchers time by killing false conjectures earlier — prateekj · 2026-07-22
- AI’s economic forecasts are split by nearly a quadrillion dollars by 2035 — bittingthembits · 2026-07-22
- Open source is becoming tech’s soft power, says Kevin Xu — kevinsxu · 2026-07-22
- OpenAI should keep giving more people access to more powerful AI — jxnlco · 2026-07-22
- Teen boys are forming AI girlfriend relationships, and critics fear real-world effects — KeanuRave100 · 2026-07-22