Epoch AI launches FrontierMath Erdős benchmark of 68 unsolved problems; Astra tops it at 2/68
keviv9 · x · 2026-09-04
Epoch AI, with mathematician Thomas Bloom, announced FrontierMath Erdős, a new benchmark of 68 unsolved Erdős problems curated from erdosproblems.com, where AI systems must prove or disprove them in Lean within a fixed compute budget.
Key points:
- Bloom's catalog lists 1,217 Erdős problems, 652 still unsolved; these problems have informally become the standard for tracking AI math progress, and the new benchmark adds rigor around curation, verification, and replicability (open-source scaffold included).
- No prior model solved any of the problems, but Astra solved 2/68 (3%), setting the top score.
Related event: Epoch AI Launches FrontierMath Erdős Benchmark, Astra Solves 2 of 68(4 posts)→
More from Models
- GPT-6 Astra skips CoT yet still answers correctly, sparking debate on CoT's privileged status — Dan_Jeffries1 · 2026-09-04
- Astra solves Excel World Championship cases ~4x faster than human champions using pure computer use — sandersted · 2026-09-04
- Researcher argues harness and MCP will be absorbed into models — data is the only wall — A_K_Nain · 2026-09-04
- Polymarket opens betting on next Grok model (4.7+) release, odds point to mid-September — Polymarket · 2026-09-04
- Ex-Google DeepMind researcher denny_zhou reveals move to Meta, worked on Muse Spark 1.1-1.3 — infoxiao · 2026-09-04
- The Real AGI Benchmark: Models Still Can't Do Data Science — max_paperclips · 2026-09-04