Gary Marcus Sparks Debate Over Whether OpenAI's Math AI Counts as Neurosymbolic
Around OpenAI's IMO-level math results, Gary Marcus fired off a series of posts on X on October 7, clashing with users like altryne and IonelChiosa over whether the system qualifies as a neurosymbolic approach. Marcus's core argument: a neural network generating large numbers of candidate solutions that are then verified by an independent symbolic system like Lean is itself a neurosymbolic method, vindicating his long-held claim that "combining neural and symbolic is the only way forward"—though he stressed this is still far from AGI. Critics pushed back on technical details.
Confirmed
- Gary Marcus explicitly distinguished two modes: a neural network solving problems on its own, versus a neural network merely proposing candidate answers that an independent symbolic system verifies—these are different things, and he argued anyone who can't tell them apart isn't qualified to comment on AI.
- Marcus pressed for verification details of the math AI system: how many solutions were actually formally verified through Lean, and whether the system's workings were publicly explained. altryne responded that the Lean proofs are an independent verification pipeline used to check outputs of a non-Lean agentic loop, not part of the generation process.
- IonelChiosa offered a detailed critique: the verification step could be replaced by a harness—nearly every time a complete solution is generated, a simple harness (e.g., fable in a simple loop) can catch errors without Lean; so the approach is LLM-engine-centric, and the harness is neither a symbolic method nor proof search.
- Marcus shared a take from @dimvar: in AI's math-proof breakthroughs, the formal verification system Lean deserves as much credit as the AI models themselves—it is the real enabler.
- When pressed by a user on whether frontier LLMs solving open math problems bare (no Lean, no code, no symbolic tools) is feasible, Marcus called it "a genuinely smart question" (his full answer wasn't elaborated in the thread).
Not Confirmed
- The actual scale and mechanics of Lean formal verification in OpenAI's IMO solution (Marcus's question about "how many solutions were verified via Lean" has received no public data response).
- The two sides never agreed on the definition of "neurosymbolic" itself: critics questioned why Marcus assumed the other party used Lean the way he envisioned, noting that to their knowledge people on the Erdős forum don't operate that way.
Why It Matters
On the surface this is a terminology dispute, but it's really about how to evaluate current math AI achievements: if Lean verification is an indispensable link, the credit goes to a "neurosymbolic system" rather than a pure LLM; if a simple harness can do the verification, it suggests the LLM engine itself is already strong enough—directly affecting the judgment of "how close we are to AGI."
2026-10-07 ~ 2026-10-07 · 10 related posts
Primary sources
- Gary Marcus: critics can't tell neural nets solving problems from nets proposing answers a symbolic system verifies — GaryMarcus ·
- Gary Marcus: OpenAI's Math Proofs Rely on Symbolic AI, Vindicating His Stance but Not AGI — GaryMarcus ·
- Critic argues OpenAI's IMO pipeline is an LLM engine, not a symbolic proof system — IonelChiosa ·
- [source] Gary Marcus: OpenAI's Math Proofs Rely on Symbolic AI, Vindicating His Stance but Not AGI — GaryMarcus · 2026-10-07
- altryne challenges Gary Marcus: Lean proofs only verify, they don't generate the results — altryne · 2026-10-07
- Gary Marcus probes math AI claims: how many solutions were tried and passed through Lean? — GaryMarcus · 2026-10-07
- Gary Marcus on the neurosymbolic debate: symbolic verification plus neural candidate generation — GaryMarcus · 2026-10-07
- [source] Gary Marcus: critics can't tell neural nets solving problems from nets proposing answers a symbolic system verifies — GaryMarcus · 2026-10-07
- Gary Marcus on whether frontier LLMs can solve open math problems without symbolic harnesses — GaryMarcus · 2026-10-07
- [source] Critic argues OpenAI's IMO pipeline is an LLM engine, not a symbolic proof system — IonelChiosa · 2026-10-07
- Critic dissects OpenAI's IMO pipeline: one-shot generation plus auto-formalization, not proof search — GaryMarcus · 2026-10-07
- Gary Marcus presses: is OpenAI's IMO 'basic harness' really just symbolic AI? — GaryMarcus · 2026-10-07
- Gary Marcus amplifies claim that Lean deserves equal credit with AI for math breakthroughs — GaryMarcus · 2026-10-07