Agent Memory Leaderboard adds first multimodal memory track with ~5,000 cases
No_Issue_8224 · reddit · 2026-11-18
The Agent Memory Leaderboard introduces a Multimodal Memory track in Cycle 2: nearly 5,000 evaluation instances from seven data sources, grouped into Memory Cognition, Memory Evolution, and Memory Alignment. Entrants may use original images, OCR, or captions but must declare which—since working from pixels is a different memory claim than working from text. Results expected mid-November, ranked separately from textual and coding tracks. The author argues stored images go stale just like text: a photo nobody updates when the scene changes is an album, not a memory.
Related event: Agent Memory Leaderboard Adds Multimodal Memory Track(2 posts)→
More from Research
- Stanford team predicts viral evolution and designs antibodies that neutralize future escape variants — BrianHie · 2026-11-18
- GPBam: New German Public Law Benchmark Finds Retrieval Gains Limited, Essay Quality Tracks Statutory Knowledge — aaire · 2026-11-18
- AI agents uncover first known genome-wide frameshifting in bacteria — GaryMarcus · 2026-11-18
- Google launches Antigravity Science plugin, gives 10,000 scientists free top-tier access — DynamicWebPaige · 2026-11-18
- AI predicts viral evolution and designs antibodies that neutralize forecasted escape variants — BrianHie · 2026-11-18
- Atomistic foundation models hit data-quality wall: fit error now below DFT label error — matt_slotnick · 2026-11-18