Open-source MCP memory server CRBRO passes 12/12 real-agent cross-session tests
AntonioJBer · reddit · 2026-10-04
The author of CRBRO, a free MIT-licensed MCP server that stores agent memory as plain JSON on your disk, ran a real-agent benchmark instead of just deterministic tests: fresh Claude Code sessions were asked questions whose answers existed only in previously seeded memory, with no prompt hints.
- 12 frozen tasks, thresholds fixed beforehand, n=3 per task
- With CRBRO: 12/12 on both Haiku and Sonnet; without: 0/12, and Sonnet hallucinated 4 answers
- Retired-vs-current value tests passed 12/12 without using stale values; controls unchanged, and it abstains when it doesn't know
- Disclosed limitations: server instructions were rewritten twice between runs, so the fourth run isn't blind; tasks are short and single-session
The author is soliciting feedback on what people use for cross-session memory (built-in Claude memory, CLAUDE.md, mem0, Letta, Zep) and why.
More from coding & agent
- Jensen Huang explains agent harness: the exoskeleton that makes LLMs useful — rohanpaul_ai · 2026-10-04
- Windows Defender flags 12 filenames in a test DLL; a JSON repack clears scans — bytebot · 2026-10-04
- Vitalik's privacy-preserving personal AI: local Qwen orchestrator + zkAPI + Tor, no data leaks — kenziyuliu · 2026-10-04
- Open source maintainer: tagging a bot makes the ship-in-public loop context-free — Baconbrix · 2026-10-04
- Open-source Chrome extension turns YouTube/Bilibili videos into readable books — vista8 · 2026-10-04
- Agent 'dot' autonomously tracked a Slack request and flagged a stale Figma placeholder overnight — dkundel · 2026-10-04