Dual RAID10 NVFP4 setup loads GLM 5.3 Flash cold in ~1 minute
TheZachMueller · x · 2026-10-13
Developer TheZachMueller shared his local inference storage setup: two separate RAID10 arrays, a smaller one as scratch and a larger one for active model weights.
He reports cold-loading the NVFP4-quantized GLM 5.3 Flash in about 1 minute, and plans to switch to NVMe-oF to speed things up further.
More from Infra
- Zuckerberg: Owning data centers is a financial edge as depreciated H100s gain value — BrentM_BuildGuy · 2026-10-13
- NVIDIA's LoGRA cuts RL training memory by 45.7%, using less than LoRA — omarsar0 · 2026-10-13
- Building a GPU compiler from scratch: lowering PyTorch to CUDA via six IRs — NoVibeCoding · 2026-10-13
- The Neocloud Map: physical ownership vs platform depth are separate axes — AccBalanced · 2026-10-13
- Will compute trade like oil? GPU rental indexes show B300 down 8.5% — AccBalanced · 2026-10-13
- Ai2 ships Olmo-core 3 training framework scaling MoE LLMs past 1 trillion parameters — dl_weekly · 2026-10-13