LinkedIn Paper Tests Memory Portability Across Models: Notes Swing ±10-13 Points, Knowledge Graphs Barely Move
dair_ai · x · 2026-09-07
A new LinkedIn paper tackles an overlooked question: can an agent's memory survive swapping the underlying model? The team stored the same agent history four ways—verbatim long context, chunked for retrieval, model-written notes, and a fixed-schema knowledge graph—then swapped the model doing the reading.
Results diverged sharply:
- Fixed-schema knowledge graphs barely moved: just 0.0004 accuracy change across a writer swap
- Model-written notes were volatile: accuracy shifted +9.91 or -13.28 points depending on swap direction
dair-ai calls memory one of the hardest things to get right when building agents and worth deliberate optimization. As users increasingly move between models, agents, and providers, memory portability is becoming a core engineering concern—especially for anyone who upgraded an agent's model only to watch it forget.
More from coding & agent
- Kolab Benchmark Uses Pro Screen Recordings to Show AI Agents Overestimate Collaboration Quality — minnesotanlp · 2026-10-27
- Dev argues Claude burns far more tokens than GPT models for the same coding work — haider1 · 2026-10-27
- Stop building agents that can't change models: stable contracts, external state, real evals — rseroter · 2026-10-27
- Cheap models can cost more in agent harnesses than frontier ones, researcher warns — vasuman · 2026-10-27
- Kanzo: A 5k-Line Rust Kanban Binary With MCP for Claude Code and Codex — allmudi · 2026-10-27
- 'A human approves everything' is a trap: approval fatigue and how to actually design safe agents — Efistoffeles · 2026-10-27