Musk: data starvation will be the training challenge next year, mocks 'pretraining' term

elonmusk · x · 2026-11-23

Replying to OpenAI's new transparency post "Perplexity and Intelligence" — which argues for shared safety bars based on perplexity and gating progress on our ability to understand AI behavior — Elon Musk predicted that unless he's missing something, data starvation will be the training challenge next year. He also mocked the terminology: you can't have pre- and post-training with never an actual "training", like dressing up to work out, showering, and never exercising.

Related event: OpenAI Publishes Pretraining Perplexity Data, Proposes Industry Safety Thresholds(35 posts)→

Original post →

More from Models

Models channel →