Keeping vLLM Prefix Cache Hot Across Multi-Turn Agent Conversations
Engineering posts explain how to keep vLLM's prefix cache hitting across agent conversation turns, avoiding repeated prefill and wasted compute.
2026-09-17 ~ 2026-09-17 · 2 related posts
- Keeping vLLM's prefix cache warm between agent turns: an engineering guide — bolts98 · 2026-09-17
- Keeping vLLM's prefix cache warm between agent turns — bolts98 · 2026-09-17