Debate with Musk Over 'Pretraining' Naming and Looming Data Exhaustion

A debate with Elon Musk over whether 'pretraining' is a misnomer evolved into deeper discussion, with Zeeshan Pishehvar arguing that pretraining through RL should be viewed as a single compute stream to understand superintelligence scaling, amid warnings that data exhaustion will be next year's challenge.

2026-11-23 ~ 2026-11-23 · 2 related posts