Samsung Unveils LPDDR5X-PIM: 614GB/s In-Memory Bandwidth
jedisct1 · x · 2026-08-29
Samsung showcased its Processing-in-Memory (PIM) technology at Hot Chips 2026. By integrating MAC units directly into LPDDR5X chips, the technology exploits high internal bandwidth and avoids latency between DRAM and compute cores.
Key Specs:
- Internal Bandwidth: 614 GB/s by accessing all 16 banks in parallel.
- External Limit: Standard DRAM maxes out at 76.8 GB/s due to interface constraints.
- Architecture: Each bank has a PIM block with a MAC tree and register files. Software loads model weights into DRAM.
More from Infra
- NVIDIA's Nemotron 3.5 Super VL hits CoreWeave: 12B-active multimodal MoE at $0.25/M input tokens — wandb · 2026-10-16
- Chip equipment beats bull case: 2026 WFE seen at $153B, $278B by 2030 — BenBajarin · 2026-10-16
- Steam now launches in 5.23s, beating Epic's 5.47s — and vLLM gets roasted for slow startup — AlpinDale · 2026-10-16
- Shadeform to Announce Six New Features on Oct 19: Lower GPU Costs, More Suppliers — _jaydeepkarale · 2026-10-16
- Fastino launches Training API for SFT/RL, claiming 25-85% cost cut vs Tinker — kalyan_kpl · 2026-10-16
- Dallas Fed: AI data center debt issuance equals ~1/8 of Treasury duration supply — _onionesque · 2026-10-16