DRAM density has flattened: servers stuck at 8TB for 5 years, CXL is the way out
lauriewired · x · 2026-09-05
lauriewired highlights an overlooked fact: DRAM density growth has essentially stalled — a maxed-out 2021 server had 8TB of RAM, and a maxed-out 2026 server still has 8TB. Five years of stagnation, and workloads exceeding 8TB are simply out of luck.
He argues the only path back to exponential growth is alternative memory tiers that bypass CPU memory controllers — specifically CXL. It carries a latency cost and demands smarter programming, but points toward a heterogeneous memory era with potentially hundreds of terabytes of RAM in a single server.
Related event: Server DRAM Stuck at 8TB for Five Years as Density Curve Flattens(3 posts)→
More from Infra
- PostgreSQL 19 slips to November as LLM-assisted code review floods committers with edge cases — sanjaykalra · 2026-10-21
- Decision Models' routing classifier hits AntSeed, cutting inference cost to 24% of always-Opus — airesearch12 · 2026-10-21
- Eon cuts engineer onboarding from 2 days to 2 minutes with an MCP Gateway on Bedrock AgentCore — AWS ML Blog · 2026-10-20
- a16z's Ben Horowitz says AI buildout isn't the 90s bubble — an investor pushes back — henloitsjoyce · 2026-10-20
- Micron and Nvidia drive ~36% of S&P 500's Q3 earnings growth — Beth_Kindig · 2026-10-20
- NVIDIA lands in Europe: Jensen Huang and German chancellor discuss industrial AI at GTC Berlin — nvidia · 2026-10-20