ITPEval Evaluates Multi-Prover Translation
AnimaAnandkumar · x · 2026-07-10
The post highlights that ITPEval will be featured at the ICML 2026 AI4Math Workshop, focusing on formal translation between Lean 4, Rocq/Coq, Isabelle/HOL, and HOL Light. The goal is not merely syntactic translation, but testing whether models can preserve mathematical semantics across different provers' foundations, libraries, theorem names, tactics, and proof styles, while simultaneously open-sourcing the multi-prover evaluation infrastructure.
More from Research
- LLM leaderboards are now often measuring the harness too, Gary Marcus warns — GaryMarcus · 2026-07-22
- New paper defines self-state attacks, showing OS defenses leave four agent-memory cases indistinguishable — Justgototheeffinmoon · 2026-07-22
- Krea 2 users recommend a two-pass Clownshark sampler setup for sharper image details — listopalafoto · 2026-07-22
- Animation shows how an MLP’s first-layer weights change while learning MNIST — CatAstro_Piyush · 2026-07-22
- Project APE finds verifier reliability drops when papers contain multiple errors — soumitrashukla9 · 2026-07-22
- Project APE says verifier costs fell about 90x in a year as Chinese open models lead — soumitrashukla9 · 2026-07-22