4 LLM families rank the Top 500 open problems in math via 34,890 pairwise judgments
burny_tech · x · 2026-09-20
ProofAtlas released a Top 500 ranking of open problems in mathematics, theoretical CS, and mathematical physics, produced by four LLM families (GPT, Claude, GLM, DeepSeek) over weeks of work.
- 34,890 pairwise comparisons across 1,227 candidates, with repeated discovery rounds, source checks, dedup, and statement clarification; models judged blindly without seeing prior rankings.
- Criteria included significance of resolution, centrality, cross-disciplinary reach, fame, and potential impact.
- Family weights: OpenAI 1.00, Claude 1.00, GLM 0.95, DeepSeek 0.90 — explicitly modeling choices, not correctness probabilities.
- Includes plain-language explanations, rank uncertainty ranges, and sensitivity checks; billed as model-based assessment, not expert consensus.
Related event: Four LLM Families Rank the Top 500 Open Math Problems(3 posts)→
More from Research
- Anthropic says it may imminently hit RSP threshold for AI-accelerated R&D, releases provable inference work — tobyordoxford · 2026-11-04
- Google scanned 1,033 real household products, packed into a 345 MB GLB for three.js — victormustar · 2026-11-04
- These 10 GPU optimization papers are why your model runs fast today — NandoDF · 2026-11-04
- INT8 isn't the problem: I benchmarked samplers on INT8 flow models — YakovSava · 2026-11-04
- Karpathy Boosts Open Hacker News Dataset: 10M+ Posts Usable as a Personal Knowledge Base — huangyun_122 · 2026-11-04
- PixelCraft: A Multi-Agent Framework Targets Multimodal AI's Chart-Reading Failures — burkov · 2026-11-04