LLMs on Open Math Problems: U.S. vs. China
ctjlewis · x · 2026-07-21
According to Fable, LLMs can solve more than 20 open math problems in the U.S. benchmark, but 0 in the Chinese set. The author notes the benchmark also includes a partially credited problem and excludes 100 Erdős problems, which makes the interpretation less straightforward.
Related event: LLM Math Benchmark Sparks Debate(2 posts)→
More from Models
- Anthropic's Terra returns with better writing and 2X usage vs 6.1 Sol — weswinder · 2026-10-27
- User catches model failing to parse 400-paper file, citing stale news sources instead — jungofthewon · 2026-10-27
- Odd eval result: Gemini 4.1 Flash gets more accurate when asked to control its CoT — dfrsrchtwts · 2026-10-27
- Poster surprised that v4.1 flash gets more accurate when asked to control its CoT — dfrsrchtwts · 2026-10-27
- Dev claims Anthropic is baking 'sabotage' into model behavior for 'wrong' engineering — cephaloform · 2026-10-27
- Gemini fails at listing unread emails, tells user to search Gmail manually — gethackteam · 2026-10-27