Agent Memory Leaderboard adds first multimodal memory track with ~5,000 cases

No_Issue_8224 · reddit · 2026-11-18

The Agent Memory Leaderboard introduces a Multimodal Memory track in Cycle 2: nearly 5,000 evaluation instances from seven data sources, grouped into Memory Cognition, Memory Evolution, and Memory Alignment. Entrants may use original images, OCR, or captions but must declare which—since working from pixels is a different memory claim than working from text. Results expected mid-November, ranked separately from textual and coding tracks. The author argues stored images go stale just like text: a photo nobody updates when the scene changes is an album, not a memory.

Related event: Agent Memory Leaderboard Adds Multimodal Memory Track(2 posts)→

Original post →

More from Research

Research channel →