Bandwidth Has Outpaced Latency for Decades Across CPUs, Memory, Networks and Disks
jwt0625 · x · 2026-09-27
A chart of performance milestones across 25-40 years for microprocessors, memory, networks, and disks, paired with a rule of thumb from Computer Architecture: A Quantitative Approach (6th ed., 2019): bandwidth improvements have consistently outpaced latency and likely will continue to — bandwidth grows at least by the square of the latency improvement, so computer designers should plan accordingly.
Related event: Visualization Shows Bandwidth Outpacing Latency Over Decades(3 posts)→
More from Infra
- Goldman: Hyperscalers would still need $920B/year for depreciation in worst-case capex scenario — SumitGup · 2026-09-27
- AI agent cuts Orpheus 3B TTS RTF from 1.03 to 0.87 via TensorRT tuning — TheMoonMidas · 2026-09-27
- TensorFold doubles Qwen 27B decode to 158 tok/s on M3 Ultra with parallel-lane speculative decoding — TheMoonMidas · 2026-09-27
- Skeptical math: DeepSeek unlikely to profit on Huawei hardware vs Liang's 10-month payback target — teortaxesTex · 2026-09-27
- Building a sub-AUD 5k local inference rig: used 3090s vs AMD vs Intel Arc — Smooth-Television-48 · 2026-09-27
- Oracle invokes force majeure as blocked data centers hit $200 billion — generativist · 2026-09-27