Researcher's lesson from an LLM formalization debacle: never use slop, even in scratch notes

_onionesque · x · 2026-10-11

onionesque reflects on an LLM-assisted math formalization episode: never use slop, not even in code documentation or scratch pads, and he apologizes for past laziness. He adds that slop Lean is no solution—the required math isn't formalized, and experts have no practical way to verify LLM-generated formalizations.

Related event: Mathematicians debate the value and risks of LLM-generated Lean proofs(3 posts)→

Original post →

More from AGI Musings

AGI Musings channel →