Ex-xAI researcher Ethan He: finding the right axis to scale matters more than raw compute
ricklamers · x · 2026-09-07
Ethan He, formerly of xAI, notes that "just scale it up" is easier said than done — the crucial part is finding the right axis to scale. Large compute clusters existed long before deep learning, but compute went to scientific computing, weather forecasting, and simulations, and GPUs prioritized FP64. Deep learning is what made AI clusters scale to unprecedented levels.
More from AGI Musings
- CJR: journalists should stop hyping AI's supposed humanity — just say 'rogue' — ShakeelHashim · 2026-10-27
- PhD applicant emails up 4x YoY due to AI — writing without AI now makes you stand out — AI4Code · 2026-10-27
- Weil's collapse shows BigLaw dies from eroding belief, not a broken business model — jkubicki · 2026-10-27
- All 8 Transformer paper authors left Google, and rival labs captured most of the frontier value — signulll · 2026-10-27
- Anthropic's S-1 pledges AI for curing diseases and serving 4.6B underserved patients — petergyang · 2026-10-27
- Goldman finds statistically significant negative link between AI adoption and US employment growth — ben_j_todd · 2026-10-27