APM-Bench: 549-session benchmark exposes utility-latency-storage trade-off in streaming video memory

Jianguo Huang · hf · 2026-09-30

APM-Bench reformulates real-world streaming interaction as multi-session life trajectories to test persistent memory for egocentric video assistants: 549 sessions, 104 trajectories, and 2,719 candidates spanning objective and open-ended questions. Evaluation of general video models and specialized streaming memory systems reveals a clear utility-latency-storage trade-off — no existing method achieves reliable long-term recall, low overhead, and effective proactive assistance simultaneously, and models still struggle to acknowledge missing evidence.

Original post →

More from Research

Research channel →