DDR5/PCIe5 is 15-20% faster for LLM pre-training, but DDR4 wins on cost per dollar
Any-Winter-4079 · reddit · 2026-10-02
Benchmarking two Vast.ai workstations (EPYC 7352 DDR4/PCIe4 vs 9975WX DDR5/PCIe5), the author found DDR5 gives 15-20% faster LLM pre-training at equal GPU count. But with current RAM prices, the cost of 256GB DDR5-6400 buys an extra RTX PRO 6000, making a dual-GPU DDR4 setup 50% higher throughput per dollar. Also covers motherboard availability, BIOS compatibility with newer GPUs, DIMM/channel trade-offs, and why inference may favor DDR5 more.
More from Infra
- tandem.cpp v0.3.0: 2-6x faster prefill for models too big for VRAM, Maya DeepSeek-V4.1 support — smflx · 2026-11-16
- Developers poll real costs of running coding agents on remote VMs for work — radim11 · 2026-11-16
- Datadog's new gateway returns 402 when a model's budget runs out—so agents just retry — YvesMulkers · 2026-11-16
- Max-quality local Minimax H3 video on a 4090: community-tested int8 setup — newaccount47 · 2026-11-16
- Local V2V outfit transfer on a 16GB M3 MacBook Air: 15.7 min cut to 2.4 min — might_thinker · 2026-11-16
- FlashStates hits 3.14x vLLM prefill throughput for hybrid-architecture agentic inference — 机器之心 · 2026-11-16