VLA Memory Design: LLM for Long-Term History, Sliding Window for Control
YouJiacheng proposed a VLA memory design using a sliding window of recent frames for real-time control while maintaining long-term history at the conceptual level in an LLM, calculating that a 256k-token budget could store minute-level visual snapshots covering 16 hours—far beyond any current VLM's memory.
2026-11-23 ~ 2026-11-23 · 3 related posts
- VLA memory debate: text-level long history plus sliding-window frames for real-time control — YouJiacheng · 2026-11-23
- Back-of-envelope: 1M context can hold 16+ hours of per-minute visual snapshots — YouJiacheng · 2026-11-23
- YouJiacheng: 16-hour visual snapshot capacity dwarfs any existing VLM memory — YouJiacheng · 2026-11-23