OpenAI researcher dismisses interpolation-regime theory as answer to data wall
willdepue · x · 2026-11-06
A user asks: if we're hitting the data wall, why not keep scaling model size and hope to enter double descent's interpolation regime where test error falls again?
OpenAI's willdepue flatly rejects the premise: "this type of theory is just not real. the interpolation regime?" The attached chart shows the classic double descent curve, with test error peaking at the interpolation threshold (1 parameter/data ratio) before declining with further scale.
Related event: OpenAI Researcher Debates Data Wall and Double Descent Theory on X(7 posts)→
More from AGI Musings
- "Reverse Alignment" initiative argues society—not just models—needs to be aligned for AI — profjamesevans · 2026-11-06
- Evans: pay data creators by contribution and surprise, verify via webs of attestation — profjamesevans · 2026-11-06
- James Evans & Glen Weyl in Science: institutions, not models, now bind AI's societal value — profjamesevans · 2026-11-06
- Greg Brockman says AI could make death optional, with disease-curing breakthroughs in 12-18 months — kimmonismus · 2026-11-06
- UK Survey: Most Think AI Will Take Jobs – Just Not Theirs — HotMinuteUK · 2026-11-06
- AI is displacing fame, broadcasting, printed knowledge, and information-hoarding leadership — StewartalsopIII · 2026-11-06