Tiered KV-cache offloading for self-hosted LLM inference: GPU to RAM to NVMe to S3

Responsible-You9024 · reddit · 2026-09-08

A practitioner is working on KV-cache offloading for self-hosted LLM inference: moving colder KV blocks down a tiered path — GPU → RAM → NVMe → S3 — instead of keeping everything in expensive VRAM. They're asking the community about real production experience: is the biggest pain VRAM capacity, latency when loading KV back, network bandwidth, or something else? Relevant reading for anyone optimizing local or large-scale inference.

Original post →

More from Infra

Infra channel →