Noam Brown: 2.5 years ago labs bragged about GSM8K — how times have changed
polynoamial · x · 2026-10-27
Noam Brown reflects that just 2.5 years ago, AI labs bragged about frontier LLM scores on the grade-school math benchmark GSM8K, now widely seen as obsolete — and wonders where the field will be in another 2.5 years.
Related event: OpenAI's Noam Brown notes GSM8K math benchmark is already obsolete(2 posts)→
More from AGI Musings
- Late Interaction: frontier AI solving millennium problems while being dumb at 1000 things makes AGI look farther — lateinteraction · 2026-10-27
- OpenAI claims rigorous Yang-Mills existence proof; physicist Woit calls the announcement misleadingly vague — burny_tech · 2026-10-27
- OpenAI internal model claims to refute ETH; Impagliazzo, Paturi and Williams to organize independent review — aminkarbasi · 2026-10-27
- MIRI researchers publicly press Anthropic: breakneck RSI racing contradicts its governance record — geoffreyirving · 2026-10-27
- Is the virtual cell the next AlphaFold? A debate on solvability — burny_tech · 2026-10-27
- Automation won't accelerate science: measurement and interpretation are the bottleneck — fkasummer · 2026-10-27