Micron AI memory roadmap: bandwidth moves onto the die, HBM supply tight from 2029
BenBajarin · x · 2026-10-22
Creative Strategies analyst Ben Bajarin shares takeaways from Micron's technology webinar and a follow-up with CTO Scott DeBoer. Key points: AI memory is becoming a system design problem—bandwidth only helps if power and capacity keep pace; each new AI memory product (HBM5, vertical HBM, vertical edge inference memory, all targeting 2028 volume) consumes more wafers per bit than the last; and their core memory model already shows HBM supply-limited from 2029, without yet counting vHBM/vEIM, so supply risk skews tighter.
More from Infra
- LLM provider TTFT monitoring reveals 7x latency spread for the same model — lluisantoni · 2026-10-22
- llama.cpp MoE expert LRU cache boosts RTX 5090 local inference 2.2x to 68 tok/s — abhishekkumar333 · 2026-10-22
- Running 748B DeepSeek-V4.1-Flash on a €2k used PC at 7.2 tok/s — Vladowski · 2026-10-22
- FlyDSL Kernels Land in PyTorch, Up to 3.01x vLLM Speedups on AMD MI350 — PyTorch · 2026-10-22
- Qualcomm's non-phone revenue seen growing 60% next year, driven by auto and embedded — pdamodaran · 2026-10-22
- After PHP advisories, a WebAssembly runtime vendor lays out its security validation plan — MickeySteamboat · 2026-10-22