Your KV Cache Can Spot Attacks on AI Agents: Intrinsec AI's Approach

AI Engineer · youtube · 2026-11-09

Intrinsec AI founder Ari Azarafrooz shows how the KV cache your inference engine already writes can double as a security signal for AI agents. Instead of judge models or per-failure classifiers, his system learns a baseline from normal traffic and flags anomalous KV pages, catching issues like a hidden spoken instruction in a voicemail where no text exists to filter. He covers integration points with vLLM, SGLang, LMCache, llm-d and NVIDIA Dynamo, plus two production hard parts: constantly changing models and KV data too large to move in real time.

Original post →

More from coding & agent

coding & agent channel →