GPT-5.6 Solves ~10% of 3,300 Open Math Problems
burny_tech · x · 2026-08-25
An experiment using GPT-5.6 Sol xhigh on 3,300 open mathematical problems resulted in roughly 170 counterexamples and 170 proofs, achieving a completion rate of around 10%. This demonstrates the current capabilities and limitations of frontier models in complex logical reasoning and mathematical proof.
Related event: GPT-5.6 Tackles 3,300 Open Math Problems, Completing About 10%(2 posts)→
More from Research
- WEDGE paper generates training environments conditioned on navigation agent failures — _akhaliq · 2026-10-16
- RExBench: best coding agent completes only 33% of autonomous research extensions — najoungkim · 2026-10-16
- Google's CLASHarness benchmarks multi-agent conflicts in computer use, finds frontier VLMs struggle — google · 2026-10-16
- Tsinghua team proves vanilla flow-matching sampling can't exceed constant-depth expressive power — SQZ · 2026-10-16
- APEX-Harm benchmark: script-based injection attacks easily compromise agents in shared workspaces — KAUST · 2026-10-16
- Residual-stream forecasts predict agent violations before they happen, USC study shows — USC · 2026-10-16