Data starvation will be next year's training challenge, researcher tells Musk

tensorqt · x · 2026-11-23

In a thread with Elon Musk and Merettm, tensorqt quibbles that "pretraining" is a misnomer — you can't have pre and post training with no actual training stage, and suggests it means "pre-cooked" rather than "before training." His substantive prediction: unless he's missing something, data starvation will be the big training challenge next year.

Original post →

More from AGI Musings

AGI Musings channel →