Zeeshan Pishehvar: Understanding Superintelligence Scaling Requires Viewing Training as One Compute Flow
ai · x · 2026-11-23
Quoting Elon Musk's quip that pretraining should just be called 'training', Zeeshan Pishehvar argues something deeper is at stake: understanding the scaling properties of superintelligence requires viewing the entire training pipeline—from pretraining to RL—as one singular flow of compute and data. Musk also predicts data starvation will be next year's core training challenge.
Related event: Debate with Musk Over 'Pretraining' Naming and Looming Data Exhaustion(2 posts)→
More from AGI Musings
- User asks Anthropic to publish a full human-agent trace of solving a Millennium Prize problem — _arohan_ · 2026-11-23
- LeCun cites Socrates' opposition to writing to counter AI capability worries — ylecun · 2026-11-23
- ENIGMA Q&A: Why Open Datasets Made Alzheimer's AI Classification Nearly Solved — PTenigma · 2026-11-23
- Mustafa Suleyman and Yuval Harari discuss AI, consciousness and humanity — krishnan · 2026-11-23
- Polymarket: Only 10% odds US enacts AI safety bill by end of 2026 — Polymarket · 2026-11-23
- OpenAI Chief Scientist warns AI could spark 'avalanche' of breakthroughs by 2027 — Polymarket · 2026-11-23