DRAM density has flattened: servers stuck at 8TB for 5 years, CXL is the way out
lauriewired · x · 2026-09-05
lauriewired highlights an overlooked fact: DRAM density growth has essentially stalled — a maxed-out 2021 server had 8TB of RAM, and a maxed-out 2026 server still has 8TB. Five years of stagnation, and workloads exceeding 8TB are simply out of luck.
He argues the only path back to exponential growth is alternative memory tiers that bypass CPU memory controllers — specifically CXL. It carries a latency cost and demands smarter programming, but points toward a heterogeneous memory era with potentially hundreds of terabytes of RAM in a single server.
More from Infra
- Notion's AI Meeting Notes run on Baseten's voice inference stack — baseten · 2026-09-05
- Two-person team hits SOTA in GPU failure prediction with a $2 PINN algorithm — sharpeye_wnl · 2026-09-05
- Huawei to produce under 4% of Nvidia's AI compute in 2026, Epoch AI estimates — Jsevillamol · 2026-09-05
- Hugging Face downloads crawl at 700kb/s on 1Gbit lines, users float p2p model distribution — perelmanych · 2026-09-05
- After ChatGPT, Claude & Grok All Went Dark, One User's 3-Machine Local AI Lab Kept Running — cocktailpeanut · 2026-09-05
- Benchmarked 21 Qwen3.8-27B quants on 16GB VRAM: bartowski IQ4_XS wins — Storterald · 2026-09-05