When the paper and the Lean proof disagree: inside AI math pipelines' backporting bug

burny_tech · x · 2026-10-09

Commenting on an AI math result, thomasahle argues models solve problems in text first, then a separate agent formalizes them into Lean. That agent may spot and repair issues in the proof but never back-ports fixes to the paper text, so papers and formalizations diverge — a recurring failure mode. His suggestion: ask the model to check how the issue is fixed in the Lean code.

Related event: Cambridge paper challenges Lean-verified AI proofs, casting doubt on OpenAI's Navier-Stokes claim(18 posts)→

Original post →

More from coding & agent

coding & agent channel →