APE-Bench: Agentic Theorem Proving in Lean
huajian_xin · x · 2026-07-06
The Seed Prover team will present APE-Bench at ICML 2026 (July 9), a benchmark that merges theorem proving with the coding agent paradigm. It models formal proofs (in Lean) into a task structure similar to SWE-Bench. The researchers propose the concept of "Agentic Proof Engineering," unifying three core challenges—deep reasoning, automated research, and coding agents—into a single task. The author has paused their PhD studies at the University of Edinburgh to pursue this research direction.
More from coding & agent
- Precompute golden answers and match at runtime: an LLM pattern from AustinLangChain — colinmcnamara · 2026-10-27
- Dev argues there's still alpha in working with your coding agent interactively — alex_frantic · 2026-10-27
- Researchers launch AMA on patterns for safer AI agents used by citizen developers — Loose_Rip359 · 2026-10-27
- Gradio Adds In-Chat Human-in-the-Loop So ML Intern Pauses Before Training — Gradio · 2026-10-27
- Building Halo Infinite Forge maps with local LLMs, DCjson and Blender MCP — swagonflyyyy · 2026-10-27
- Ex-Unity dev Lucas Meijer says OpenClaw looks cleaned up and worth another run — lucasmeijer · 2026-10-27