Chinese Researchers Open-Source Cache-to-Cache: LLMs Talk Without Tokens, +14.2% Accuracy
Scobleizer · x · 2026-09-18
Chinese researchers open-sourced Cache-to-Cache (C2C), a paradigm letting LLMs communicate without generating a single word. Today, multi-agent systems must translate internal "thoughts" into text tokens, losing semantic richness and adding token-by-token latency. C2C instead uses a neural network to directly project and fuse the source model's KV-cache into the target model — pure semantic communication — with a learnable gating mechanism to pick which layers benefit most from cache transfer. Results: zero intermediate text-generation latency and accuracy gains of up to 14.2% over individual models.
More from Research
- Gradient-free weight editing cuts VLM FigStep attack success from 49% to 2% — lateinteraction · 2026-11-04
- Anthropic says it may imminently hit RSP threshold for AI-accelerated R&D, releases provable inference work — tobyordoxford · 2026-11-04
- Google scanned 1,033 real household products, packed into a 345 MB GLB for three.js — victormustar · 2026-11-04
- These 10 GPU optimization papers are why your model runs fast today — NandoDF · 2026-11-04
- INT8 isn't the problem: I benchmarked samplers on INT8 flow models — YakovSava · 2026-11-04
- Karpathy Boosts Open Hacker News Dataset: 10M+ Posts Usable as a Personal Knowledge Base — huangyun_122 · 2026-11-04