Musk: data starvation will be the training challenge next year, mocks 'pretraining' term
elonmusk · x · 2026-11-23
Replying to OpenAI's new transparency post "Perplexity and Intelligence" — which argues for shared safety bars based on perplexity and gating progress on our ability to understand AI behavior — Elon Musk predicted that unless he's missing something, data starvation will be the training challenge next year. He also mocked the terminology: you can't have pre- and post-training with never an actual "training", like dressing up to work out, showering, and never exercising.
More from Models
- Gemini Ultra bundles 1000 monthly Colab credits — ~55 H100 hours for your agent — RileyRalmuto · 2026-11-23
- Leaked OpenAI loss ladder: unknown capabilities await at 0.68-0.7 — tallmetommy · 2026-11-23
- Developers heap praise on Gemini 4 Neon's 'most tasteful' writing — gajesh · 2026-11-23
- METR-fit extrapolation implies 66-hour task horizons for 6.2 Astra, 128 hours for internal model — eliebakouch · 2026-11-23
- $200 Google AI Ultra subscription quietly includes a 96GB Blackwell GPU for 10 days — kieranklaassen · 2026-11-23
- Tesla FSD insider: end-to-end is settled, winning hinges on data diet quality — Singularitarian · 2026-11-23