16 Gen5 NVMe drives in RAID 0 hit 208GB/s, matching 4-channel DDR5
carrigmat · x · 2026-08-27
carrigmat addresses the two biggest objections to running frontier LLMs from NVMe instead of GPU/RAM:
- SSD wear: modern SSDs have virtually infinite read lifetimes; weights are copied once and then it's all reads.
- Bandwidth: one Gen5 NVMe gives 13GB/s; 16 in RAID 0 reach 208GB/s, equivalent to 4-channel DDR5.
More from Infra
- Prefix Sliding enables efficient test-time scaling by cutting memory costs — Niklas Muennighoff · 2026-08-27
- Cohere releases Parse 5, claiming best price-performance for enterprise document parsing — irombie · 2026-08-27
- M7 Ultra may feature native FP8, potentially boosting GLM 5.3-flash performance — Brilliant-Hall1387 · 2026-08-27
- ChronoScale announces 50MW NVIDIA GB300 deployment with Microsoft for AI inference — r_jegaa · 2026-08-27
- Engineering Win: mxfp8 x mxfp4 Matmul Outperforms Standard mxfp8 — zephyr_z9 · 2026-08-27
- The Guardian video: everyone hates datacentres — but do we really need them? — nordicinst · 2026-08-27