Server RAM stuck at 8TB for five years as DRAM density curve flattens
MikePFrank · x · 2026-09-05
Developer LaurieWired points out that the DRAM density curve has basically flattened: a maxed-out server had 8TB of RAM in 2021, and a maxed-out server in 2026 still has 8TB — five years of stagnation. If your working set exceeds 8TB, you're out of luck.
Mike Frank responded that 3D DRAM will be a thing. LaurieWired argues the only path back to exponential growth is alternative memory tiers that don't rely on CPU memory controllers — a memory-wall problem that directly affects AI training and inference workloads.
Related event: Server DRAM Stuck at 8TB for Five Years as Density Curve Flattens(3 posts)→
More from Infra
- Corporate token spending growth collapses from 42% to 0.2% as hyperscaler ROIC falls to 20% — SumitGup · 2026-10-21
- Qualcomm plans worldwide performance-based layoffs as it chases $5B AI data center revenue — rohanpaul_ai · 2026-10-21
- vLLM at PyTorchCon 2026: KV cache and kernel optimizations across TPU, AMD, and NVIDIA — PyTorch · 2026-10-21
- antirez to port DeepSeek Infer kernels to DGX Spark's SM121 for DwarfStar — antirez · 2026-10-21
- Ternary-Bonsai-2-9B: 2-bit ternary vision-language model trends on Hugging Face for on-device use — prism-ml · 2026-10-21
- General Compute x Positron: GPUs Handle Prefill, Memory-First Chips Tackle Decode-Bound LLM Inference — cneuralnetwork · 2026-10-21