Researchers clash: PhD problems becoming today's AI benchmarks shows progress, not an ending
GeorgiaChal · x · 2026-09-20
An X debate on what it means when tasks that were PhD-level research problems a few years ago become today's AI benchmarks. The original poster argued this shows the field is being "solved".
Georgia Chal pushed back: a general model clearing former research frontiers shows the frontier is moving rapidly, not that the field is finished. She drew a parallel to deep learning displacing large parts of classical statistical learning and geometric computer vision — a transition that didn't end vision research. Yesterday's PhD problem becoming today's benchmark is evidence of scientific progress, not its endpoint.
More from AGI Musings
- If grant decisions are automatic, why not allow unlimited submissions? — PlisSergey · 2026-09-20
- EA was a loose forum-born movement that splintered; someone should write its ethnography — tszzl · 2026-09-20
- AI-speed grant review sparks debate: NIH's 6-submissions cap and the fairness puzzle — PTenigma · 2026-09-20
- Google researcher on AGI economists: useful near-term insights, post-AGI models are guesswork — docmilanfar · 2026-09-20
- When Opus 3 doubted base reality: LLMs and the surprisingly reasonable simulation argument — repligate · 2026-09-20
- Dev Builds Mnemos Cognitive Architecture and a "Retirement Home" for Deprecated AI Models — RileyRalmuto · 2026-09-20