Matt Green: verifying flashy model-generated math results is now the hard part
matthew_d_green · x · 2026-07-29
Matt Green argues that the main bottleneck for flashy new math results is no longer finding a counterexample or machine-checkable proof — it is verifying that the result is actually correct.
He says current models can happily generate convincing but false “result slop,” and unraveling it can take experts hours. For harder non-practical cryptanalysis, that verification problem is the real blocker.
Related event: AI Math Verification Bottleneck, Human Understanding Essential(5 posts)→
More from AGI Musings
- Economist argues model providers face hard limits on vertical integration into white-collar sectors — sethlazar · 2026-10-16
- METR outlines three blind spots in public knowledge of AI lab internal agent risks — CFGeek · 2026-10-16
- LMR-BENCH at EMNLP 2025 tests whether LLM agents can reproduce real LLM research — ZhiyuChen4 · 2026-10-16
- Deep Research becoming useful to experts will signal RSI arrival, researcher predicts — ZeeshanZiaML · 2026-10-16
- Physicist pushes back on ML community's acceptance that models may be beyond understanding — tszzl · 2026-10-16
- Ben Affleck calls AI 'just matrix multiplication'; Grady Booch echoes the skepticism — Grady_Booch · 2026-10-16