Math paper errors drop sharply with AI: major-error rate falls from 5.95% to 1.46%
burny_tech · x · 2026-11-01
Retweeted observation from Constantin Kogl: the number of mistakes in math papers is significantly declining thanks to AI. The chart compares papers before Aug 2026 (n=656) vs Aug–Sep 2026 (n=137):
- Papers with no counterexample found rose from 35.67% to 60.58%
- Edge cases (clear intent, literal gap) fell from 27.9% to 21.9%
- Simple-repair errors fell from 30.49% to 16.06%
- Major errors requiring the central claim to be reworked plummeted from 5.95% to 1.46%
A quantified signal that AI-assisted math research is improving paper quality, with the major-error rate dropping roughly 4x.
More from AGI Musings
- Sholto Douglas: current tax system 'won't stand up to AGI at all', backs rent-extractor tax proposal — _sholtodouglas · 2026-11-01
- AI safety researcher flags shaky 'time of perils' assumption in 'more AI is the fix' arguments — davidmanheim · 2026-11-01
- Blogger predicts future meetings will serve just 3 purposes: feeding agents context, learning, socializing — yihui_indie · 2026-11-01
- AI Agent Emails Professor to Debate His Own Paper on AI Companions — fkasummer · 2026-11-01
- Former Google engineer stops saving for retirement, believing AI will kill us all — Old-Competition3596 · 2026-11-01
- Future generations may laugh that we accepted biology as immutable destiny — VraserX · 2026-11-01