MEMOIR: open-source benchmark tests AI memory on 117 synthetic oncology patients
jefrankle · x · 2026-09-24
MEMOIR (Memory Evaluation over Multi-year Oncology Inference & Retrieval) is a new open-source benchmark for longitudinal clinical memory: 117 synthetic oncology patients, 65,377 clinical events, and 3,617 questions covering factual retrieval, rare-event detection, episode reconstruction, and longitudinal reasoning. The authors argue clinical memory differs structurally from conversational memory — histories span multiple systems, frequencies, and years. Evaluated approaches include vector memory (mem0), temporal knowledge graphs (Graphiti), and agent-managed memory (Letta).
More from Research
- AlphaGenome 2 commercial API enters Google Cloud private preview, weights promised later — anshulkundaje · 2026-11-11
- DeepMind launches AlphaGenome 2 with major performance leap in variant-effect prediction — anshulkundaje · 2026-11-11
- Nearly 30% of US STEM PhD dissertations now have AI-generated abstracts, NBER study finds — joshgans · 2026-11-11
- Stanford's DyCraft Uses Agentic Decomposition to Cut Physical Errors in Long-Horizon 4D Scene Generation — StanfordUniversity · 2026-11-11
- Bert Chan on His Unconventional Path from Side-Projects to the ALife Institute — BertChakovsky · 2026-11-11
- CGM Study of 62,000 People: Average Glucose Beats HgbA1C at Detecting High Insulin — arjunrajlab · 2026-11-11