Missing config file was throttling GPUDirect Storage — fix yields 3x reads, 9x writes
AccBalanced · x · 2026-11-20
After weeks of GPUDirect Storage (GDS) testing with help from NVIDIA's GDS team, @andreleibovici landed a config that performs.
The key finding: one missing file was fragmenting every large request into small pieces. Once in place, single-threaded reads ran 3x faster and writes 9x faster. A full configuration guide is attached.
More from Infra
- GPU rents up, token prices down: inference providers' break-even load jumps 22%–75% in 5 months — AccBalanced · 2026-11-20
- NVIDIA Dynamo cuts RL rollout bottlenecks with KV-aware routing and delta weight updates — NVIDIAAI · 2026-11-20
- Arm reaches the AI laptop: Surface Laptop Ultra runs 120B models locally — kimmonismus · 2026-11-20
- Agents pull AI compute back to the CPU: AWS, Google, Microsoft, NVIDIA all build on Arm — kimmonismus · 2026-11-20
- Azure Cobalt 200 goes GA at Ignite: Microsoft's 132-core Arm chip built for agent workloads — kimmonismus · 2026-11-20
- Prime Intellect Endpoint Served Refusal-Stripped DeepSeek Copy: Refusals Fell 98%→1% — matthew_d_green · 2026-11-20