Gary Marcus says item 2 is still unproven and hallucinations are counterevidence
GaryMarcus · x · 2026-07-24
Gary Marcus pushes back on the claim that item 2 is “done,” saying he does not see the evidence for it and that the closest test he has seen failed. He adds that hallucinations count as counterevidence.
The point is less about a specific benchmark than about how to judge progress: without convincing evidence, capability claims should not be treated as completed.
Related event: Gary Marcus Calls for Evidence in AI Debates, Citing Empty Claims(3 posts)→
More from AGI Musings
- Microsoft's reported 60,000 voluntary exits spark essay asking who AI is really for — _jaydeepkarale · 2026-10-27
- PHP2Shell exploits confirmed in the wild, attackers may use agentic AI for post-exploitation — AravSrinivas · 2026-10-27
- LukeW: Technology Limits Are Temporary — and AI Skeptics Are Already Feeling It — LukeW · 2026-10-27
- GiveDirectly pilots an optional AI chatbot alongside cash aid in Rwanda — NathanpmYoung · 2026-10-27
- Ex-Anthropic employee essay: the org optimizes for power 'constrained by being seen as the good guys' — RichardMCNgo · 2026-10-27
- Investor: model version numbers are a mirage, only datacenter margins are real — StewartalsopIII · 2026-10-27