Hennessy & Patterson's rule: bandwidth grows at least as the square of latency gains
jwt0625 · x · 2026-09-27
A rule of thumb from Computer Architecture: A Quantitative Approach, 6th edition (2019): bandwidth has outpaced latency across technologies and likely will continue to, with bandwidth growing at least as the square of the latency improvement — computer designers should plan accordingly. Highly relevant to how GPU interconnects, memory, and networking are evolving today.
Related event: Visualization Shows Bandwidth Outpacing Latency Over Decades(3 posts)→
More from Infra
- Oracle invokes force majeure as blocked data centers hit $200 billion — generativist · 2026-09-27
- Sugon-8000 showcased with immersion phase-change liquid cooling using 50C refrigerant — teortaxesTex · 2026-09-27
- RTX 5090 now smuggled alongside cigarettes as prices hit $7,000-$10,000 — AIFlow_ML · 2026-09-27
- AWS adds cross-account centralized buses and FIFO ordering to EventBridge — DavidWells · 2026-09-27
- Third bit-level Tensor Core model in a row broken by same pair of testcases — i_komarov · 2026-09-27
- 42x Faster Prompt Lookup Drafting in llama.cpp — Available_Pressure47 · 2026-09-27