Google DeepMind Releases 'How To Scale Your Model': A Systems View of LLMs
philhchen · x · 2026-08-18
Google DeepMind has released a new book, 'How To Scale Your Model', providing a systems perspective on LLMs running on TPUs and GPUs. It covers Roofline analysis, inter-device communication, parallelization strategies for training and inference, and cost estimation. The book aims to demystify the science of scaling models for developers optimizing performance at massive scale.
More from Infra
- Jensen Huang: Musk's AI buildout moved from K's to M's, now a CSP-tier NVIDIA customer — elonmusk · 2026-10-16
- EpochAI pegs GPT-6 training at up to 1.8e27 FLOP; scaling01 calls param estimates way too high — scaling01 · 2026-10-16
- Meta's Muse Spark Open scores 39 vs 48 for closed Spark 1.3 on AA Intelligence Index — EAccelerate_42 · 2026-10-16
- LLM spots useless 95GB-per-frame memcpy in ffmpeg dblur, cutting runtime from 2452ms to 49ms — IgorCarron · 2026-10-16
- DeepSeek-V4-Flash on 4x Radeon AI PRO R9700: the 'refused' 4-card config hits ~79 tok/s — brainchillzZ · 2026-10-16
- Tree packing lands in TRL's AsyncGRPO, cutting agentic RL training compute by over 26x — joecole · 2026-10-16