DeepSeek Engram debate: bandwidth, not storage, is the real constraint
bookwormengr · x · 2026-09-22
In a thread on DeepSeek's Engram, bookwormengr argues sparsity (MoE, sparse attention) is already at 90%; the bigger constraint is HBM bandwidth, which is costlier than storage. DeepSeek's designs target bandwidth, and Engram's extreme KV compression benefits both. He claims Huawei's "HBM" is closer to LPDDR; zephyrz9 counters that HiZQ is real HBM (cHBM).
Related event: DeepSeek Engram Is Semantic Retrieval, Can Cut HBM Needs 40-50%(4 posts)→
More from Infra
- Cloudflare Talk: Swapping Some Agent LLM Calls for Fast Models Like Jev Gives Big Speedups — michellechen · 2026-11-12
- Cloudflare Trains Its Own Clef and Clairic Models to Complete Its Agent Stack — michellechen · 2026-11-12
- AWS open-sources 23 production-ready GenAI assets, cutting build time from months to weeks — AWS ML Blog · 2026-11-12
- Sixth Street CEO: ~$200B of Chips Sitting in Warehouses as Data Centers Lag Behind — SumitGup · 2026-11-12
- AWS CEO Matt Garman: Space Data Centers Are 10-20 Years Away, Likely Not Economically Feasible — rohanpaul_ai · 2026-11-12
- CoreWeave Database Goes GA: Managed PostgreSQL Running Inside Your CKS Cluster Next to GPUs — _ScottCondron · 2026-11-12