Scoring 80+ on MMLU is Just Another Tuesday Now
andrew_n_carr · x · 2026-07-22
Tech professional Andrew Carr marvels at the rapid pace of the AI industry: just a year and a half ago, a large language model scoring over 80 on the MMLU (Massive Multitask Language Understanding) benchmark was an industry-shaking event; today, it's just another Tuesday.
This observation resonates with many, directly reflecting how quickly the baseline capabilities of frontier AI models are escalating, and how the psychological threshold for high-performing LLMs continues to rise.
More from AGI Musings
- CS professor: don't hide your AI use from future employers, lead with it — lemire · 2026-10-26
- Engineer: AI-cheap engineering will change which manufacturing jobs get a yes — burhop · 2026-10-26
- FixItBench: the joke benchmark where robot-agent teams race to repair electron microscopes — teortaxesTex · 2026-10-26
- Instructor advice: record and save all your teaching materials for future AI use — prof_g · 2026-10-26
- Jason Furman: Building Econvitals pre-AI would need ~50 people, 3 years, $20M — HarrySurden · 2026-10-26
- Dune's 1960s Warning on Handing Thinking to Machines Resurfaces in AI Debate — umeshonai · 2026-10-26