MIT's 'AI telepathy' KV-cache transfer beats text by 40% accuracy at 4x speed, across model vendors

LucaAmb · x · 2026-10-29

MIT researchers built a mechanism for AIs to communicate by directly passing internal states (KV-cache) instead of text — reportedly 40% more accurate and 4x faster, and it works across vendors (Llama 3 ↔ Qwen 3 ↔ Gemma ↔ Granite, etc.). davidad predicts that by 2028Q1 this will end CoT monitoring as we know it, improve inference-time scaling curves, and make context-window size far less important.

Original post →

More from AGI Musings

AGI Musings channel →