Leak: 950DT Has Only 4 HiZQ Stacks, ~1TB/s Bandwidth Each
zephyr_z9 · x · 2026-07-03
zephyrz9 reveals that the 950DT is equipped with only 4 HiZQ stacks, with an aggregated bandwidth of about 1TB/s per stack (sitting between HBM3's 819GB/s and HBM3E's 1.12–1.25TB/s). It also offers two memory variants: 8Hi (24GB) and 12Hi (36GB).
More from Infra
- Engram's random reads don't suit SSDs; CPU-memory over NVLink could serve all 72 GPUs — bookwormengr · 2026-09-11
- 80% of the DIY LLM inference hype posters have already quit — it's brutally hard systems work — abhijithneil · 2026-09-11
- Hugging Face's Ultra Scale Playbook: a free book on training LLMs on GPU clusters — mdancho84 · 2026-09-11
- Is inference latency becoming the biggest bottleneck for production AI agents? — Euphoric_Sea632 · 2026-09-11
- LLM Serving Metrics Thread: Why TPOT and Uptime Make or Break User Experience — abhijithneil · 2026-09-11
- PlanetScale launches sharded Postgres: 768 servers acting as one, 1PB scale — dhruv2038 · 2026-09-11