AI agent resolves 100+ of 244 open math problems; proofs withheld to avoid contamination

wellecks · x · 2026-10-20

A team led by Zeyu Zheng released results on a benchmark of 244 open math problems: the Leanimum Agent resolved over 100 of them. Paper, benchmark, and the Leanimum Agent are public, but the team says proofs won't be released — keeping benchmark solutions private is good practice to mitigate training-data contamination. A notable empirical advance for AI in formal mathematics (Lean).

Related event: reuF2F benchmark: frontier agents solve only ~44% of 244 formalized open REU math problems(5 posts)→

Original post →

More from Research

Research channel →