MIT prof: model capabilities follow a scaling law, with a threshold for open math discovery already crossed
ProfBuehlerMIT · x · 2026-11-23
MIT professor Markus Buehler highlights @merettm's work showing broader categories of model capability follow scaling laws: around 0.76 log-perplexity on OpenAI's benchmark, models began producing results on extremely complex open math problems.
He argues we're entering a new scaling regime that may yield qualitatively different open-ended discovery capability. Justin Bullock adds that "a threshold in what these models can do seems to have been crossed," and expansions into lower tiers will likely be even more consequential — though what comes next remains unknown.
More from Models
- OpenAI opens pretraining data: time horizon scales exponentially with perplexity — danielrock · 2026-11-23
- 'You're Routed to Opus 4.6': Matthew Berman's Model-Routing Surprise Moment — MatthewBerman · 2026-11-23
- Reddit Hands-on With inkling-mini-2: Coherent and Careful, but Overly Cautious — Express_Quail_1493 · 2026-11-23
- Matt Wolfe: Google Is Back With Its New AI Model — Weekly AI News Roundup — Matt Wolfe · 2026-11-23
- Google's AI Overview triggers on single letter but not complex queries — VeredShwartz · 2026-11-23
- Voyager releases open-source shot-reader-8b multimodal model on Hugging Face — ravisparikh · 2026-11-23