DRAM density has been flat for 5 years — maxed servers stuck at 8TB, CXL is the only way out
bexbsd · x · 2026-09-05
lauriewired points out that the DRAM density curve has basically flattened: a maxed-out server had 8TB of RAM in 2021 and still 8TB in 2026 — five years of stagnation. If your working set exceeds 8TB, tough luck.
His take: the only path back to exponential growth is alternative memory tiers that don't rely on CPU memory controllers — i.e. CXL. A reply notes that Felix (FelixCLC) has differing views on CXL, feeding an ongoing technical debate.
Related event: Server DRAM Stuck at 8TB for Five Years as Density Curve Flattens(3 posts)→
More from Infra
- Corporate token spending growth collapses from 42% to 0.2% as hyperscaler ROIC falls to 20% — SumitGup · 2026-10-21
- Qualcomm plans worldwide performance-based layoffs as it chases $5B AI data center revenue — rohanpaul_ai · 2026-10-21
- vLLM at PyTorchCon 2026: KV cache and kernel optimizations across TPU, AMD, and NVIDIA — PyTorch · 2026-10-21
- antirez to port DeepSeek Infer kernels to DGX Spark's SM121 for DwarfStar — antirez · 2026-10-21
- Ternary-Bonsai-2-9B: 2-bit ternary vision-language model trends on Hugging Face for on-device use — prism-ml · 2026-10-21
- General Compute x Positron: GPUs Handle Prefill, Memory-First Chips Tackle Decode-Bound LLM Inference — cneuralnetwork · 2026-10-21