GPT-5.6 achieves ~10% success rate on 3,300 open math problems
littmath · x · 2026-08-25
Sasho revisited a list of open math problems from a decade-old workshop to test AI capabilities, specifically using GPT-5.6 Sol xhigh.
- The model was tested on 3,300 open problems, resulting in roughly 170 counterexamples and 170 proofs.
- This represents a completion rate of about 10%.
- The difficulty of open problems varies significantly, with current AI mostly solving trivialities.
Related event: GPT-5.6 Tackles 3,300 Open Math Problems, Completing About 10%(2 posts)→
More from Models
- Nathan Lambert slams Meta's Muse Open License as 'trash' — natolambert · 2026-10-16
- Google launches Gemini 4 Argon to Ultra and Pro subscribers, touting physics and 3D skills — ShikharMurty · 2026-10-16
- Google gives X users early access to test Argon, not just companies — lyraxana · 2026-10-16
- Grok Voice 3.0 Tops Design Arena Speech Leaderboard, Up 7.4 Points — XFreeze · 2026-10-16
- Robotics LLMs tested on 16 tasks: GPT-6 Astra hits 17.2% success vs Fable's 9.1% — pabbeel · 2026-10-16
- Meta open-sources Muse Spark: top US open model, scores just below DeepSeek — bindureddy · 2026-10-16