UnsolvedMath dataset hits 17,614 open problems for LLMs, drawing mathematicians' ire
tak3sh8 · x · 2026-10-21
Chojecki announced UnsolvedMath v1.8, an open dataset of now 17,614 unsolved math problems for LLMs to tackle, adding all Erdős problems (including solved ones) and the Kourovka Notebook, with a Hugging Face release and companion forum.
The update drew criticism: mathematician Quasilocal called it "pretty gross," saying it appears to have scraped every problem researchers mentioned working on in venues like Oberwolfach reports and set them as targets for prompters "with no interest in mathematical understanding" — highlighting growing tension between mathematicians and LLM-benchmarking efforts.
More from Research
- Artios launches as a fully open-source system for designing functional de novo enzymes — rishabh16_ · 2026-10-21
- PyTorch Conference talk: how beginners can get started with profiling — ariG23498 · 2026-10-21
- World's oldest AI accelerator CDL enters year 12, fully pivoted to AI for Science — Afinetheorem · 2026-10-21
- Independent test: Liquid d1-ultra scores 77.1%, dethroning Perplexity's Decider v1.2 by 10 points — JosephJacks_ · 2026-10-21
- Reflection AI open-sources RL post-training recipes for Beam 1.0, a 501B MoE with 23B active params — ying11231 · 2026-10-21
- LangArena benchmark: Goose 42% faster than C and Rust across 50 real-world tasks — pbaylies · 2026-10-21