Nathan Lambert: an effective org is worth multiples in compute for training frontier models
natolambert · x · 2026-10-28
Nathan Lambert argues the importance of org chart and team structure in building good LLMs is vastly underrated, citing his 18-month-old Interconnects post on managing frontier training orgs. It explains why orgs like Llama/xAI crumble and get rebuilt, and why underdogs can catch up — an effective org is worth multiples in compute. He adds there isn't much secret sauce to model-building: most gains come from consistent execution and wise compute use.
More from AGI Musings
- AI pundit predicts the 2020s will be the last decade of widespread poverty — Dr_Singularity · 2026-10-28
- Essay: your bodymind runs on --dangerously-skip-permissions, and you never opted in — mimi10v3 · 2026-10-28
- LAIKA director vows never to use generative AI in films: "AI is theft" — moultano · 2026-10-28
- Ethan Mollick: the "AI is all fake" conspiracy should have died, but won't — emollick · 2026-10-28
- Artisans refusing AI is a luxury the real economy can't afford — moultano · 2026-10-28
- Google researcher: refusing AI as an artisan is honorable but impractical for the economy — moultano · 2026-10-28