ENGRAM and YOCO memory architectures could shift data center DRAM/HBM economics
AccBalanced · x · 2026-09-27
- Citing SemiAnalysis, ENGRAM memory tech could lift revenue per GW by 50% — a multi-billion-dollar tailwind for AI.
- ENGRAM plus YOCO-style architectures (author claims DeepSeek V4.1 Flash and Mimo V3 started the pattern) will tilt data center DRAM/HBM ratios toward DRAM: since 1 HBM bit ≈ 3 DRAM bits in cost, hyperscalers and labs save heavily.
- Asymmetric prefill-decode with tiny KV footprints makes DRAM nearly as cheap as SSD offload for KV caching, and makes HBF viable for prefill; Meta's Muse build-out also helps.
- Part 2 to follow.
More from Infra
- Dev caches hide 264 CVE-laden packages and 71.7 GiB no one audits, warns Cache Commander dev — julsimon · 2026-09-27
- OpenAI files trademark for "Habanero" covering chips, semiconductors and ICs — imjustnewatai · 2026-09-27
- OpenAI files trademark for "Scotch Bonnet", covering AI processors, HPC and data center hardware — imjustnewatai · 2026-09-27
- OpenAI files trademark for "Cayenne" covering AI chips and data center hardware — imjustnewatai · 2026-09-27
- OpenAI Files 'Serrano' Trademark Covering AI Chips and Data Center Hardware — imjustnewatai · 2026-09-27
- NVIDIA B300 index goes live at $6.95/GPU-hr, rents up 43.9% since April — AccBalanced · 2026-09-27