On RL envs for math: informal methods generalize, formal ones don't

OfirPress · x · 2026-10-10

Will Dequeant argues formal methods don't generalize to informal domains while informal methods generalize to formal ones — solving "loosely verifiable problems" generally beats solving only Lean-expressible ones. OfirPress follows up asking whether such RL envs are just natural-language prompts with an LLM-as-a-judge verifier, either via formalizing into Lean or reading the proof.

Original post →

More from Research

Research channel →