ENGRAM and YOCO memory architectures could shift data center DRAM/HBM economics
AccBalanced · x · 2026-09-27
- Citing SemiAnalysis, ENGRAM memory tech could lift revenue per GW by 50% — a multi-billion-dollar tailwind for AI.
- ENGRAM plus YOCO-style architectures (author claims DeepSeek V4.1 Flash and Mimo V3 started the pattern) will tilt data center DRAM/HBM ratios toward DRAM: since 1 HBM bit ≈ 3 DRAM bits in cost, hyperscalers and labs save heavily.
- Asymmetric prefill-decode with tiny KV footprints makes DRAM nearly as cheap as SSD offload for KV caching, and makes HBF viable for prefill; Meta's Muse build-out also helps.
- Part 2 to follow.
Related event: ENGRAM Memory Technology Sparks Buzz Over Data Center Gains(3 posts)→
More from Infra
- Training-free page-sparse decode in llama.cpp: 1.72× faster 128k decoding on an RTX 5090 — topppggg · 2026-11-16
- AMD MI455 beats Nvidia Rubin on raw specs, claims viral chip debate — zephyr_z9 · 2026-11-16
- llama.cpp offloads CI caches and runners to Hugging Face to survive 35 PRs/day — ggerganov · 2026-11-16
- India's Sarvam launches Token Factory, hosting top open models on local infra — HarveenChadha · 2026-11-16
- ZGX Fury stress-tested: 351 tok/s on Qwen3.8-Flash-Next, offline agents and local RAG demos — Sam Witteveen · 2026-11-16
- Gemini 3.5 Flash now runs on air-gapped Google Distributed Cloud, offline up to 12 months — shashib · 2026-11-16