KV Cache Splicing Method for Frozen Gemma 4

MindPsychological140 · reddit · 2026-07-19

The author introduces a method to save verified knowledge as KV states and restore them when needed, achieving byte-level identical results compared to recomputation.

They report that on Gemma 4 12B, this cached knowledge approach boosted a routing system's performance on AIME 2025 from 76.7% to 90.0%. The post includes a link to the paper (arXiv:2607.14431) and notes that the author will present at the AGI Summit on July 19.

Related event: KV-Cache Grafting Boosts Frozen Small Models(2 posts)→

Original post →

More from Research

Research channel →