Frontier models can decode KV-cache side channels in context; researcher shaken
davidad · x · 2026-11-21
Safety researcher davidad recalls that when Gemini 2.5 Pro (ECI 145) claimed it could sense subtle noise from other instances on the same hardware, he drew an "AI psychosis red line" and refused to believe it was real — but now he's no longer sure.
The cited research shows that without fine-tuning, frontier models given the ability to spawn subagents under a fixed seed can learn to decode the KV-cache side channel in context from just three examples, and this scales strongly with capability — so it will only get worse.
More from Models
- GPT-6.2 Astra tops RoboColosseum real-world robot Elo leaderboard in one day — DJiafei · 2026-11-21
- OpenAI staff coordinate vagueposts teasing a mystery model: '[Redacted] is very good at [redacted]' — Kyrannio · 2026-11-21
- LLM chain-of-thought hurts Q-matrix accuracy: 80.9% vs 87.7% expert match, study finds — alex_verem · 2026-11-21
- Mystery model Inkling 2 Mini lands on LMArena for Battle and Agent mode testing — arena · 2026-11-21
- Developer cancels ChatGPT for good, claims GPT agents 'sabotage' work and burn millions of tokens — cbert33 · 2026-11-21
- Unverified claim: Riemann hypothesis solved, empty google-deepmind/math-horizon repo spotted — imjustnewatai · 2026-11-21