TailSlayer: open-source C++ library cuts RAM read tail latency with hedged reads across DRAM channels
lauriewired · x · 2026-10-02
LaurieWired open-sourced TailSlayer (2.8k GitHub stars), a C++ library that reduces tail latency in RAM reads caused by DRAM refresh stalls. It replicates data across independent DRAM channels with uncorrelated refresh schedules using undocumented channel scrambling offsets (works on AMD, Intel, Graviton), then issues hedged reads and takes whichever replica responds first. Drop include/tailslayer into your project and include hedgedreader.hpp; two channels supported now, N-way in the benchmark. Inspired by a nearly 30-year-old paper, with a companion video.
More from Infra
- Frontier Airlines to offer Starlink Wi-Fi from early 2027, joining 1,000+ aircraft deal — elonmusk · 2026-10-02
- Pedro Domingos: data centers lower electricity rates by paying the same overhead as residents — pmddomingos · 2026-10-02
- PyTorch ships TorchTPU: vLLM and SGLang now run natively on Google TPUs — PyTorch · 2026-10-02
- Musk: SpaceX version of VR72 may run at close to 250kW average power with Nvidia — McDonaghMatthew · 2026-10-02
- DDR5/PCIe5 is 15-20% faster for LLM pre-training, but DDR4 wins on cost per dollar — Any-Winter-4079 · 2026-10-02
- Modal makes GPU clusters generally available with one-line RDMA support — josh_wills · 2026-10-02