HOLA: Adding Hippocampus-like Precise Memory to Linear Attention
omarsar0 · x · 2026-07-03
A new paper proposes HOLA: adding a bounded exact KV memory module on top of the compressed recurrent states of linear attention or state space models, acting as a "hippocampal" supplement. Linear attention compresses the entire context into a fixed-size state to achieve O(1) memory, but early facts get overwritten and needle recall degrades when numerous key-value associations compete. HOLA restores long-term memory capabilities without sacrificing the efficiency of linear attention.
More from Research
- Researcher bootstraps from fly connectome to build increasingly intelligent connectomes — airkatakana · 2026-09-11
- CellFluxRL: RL-based biological grounding for virtual cell models, submitted to ECCV 2026 — Prof_Lundberg · 2026-09-11
- PiPNN nearest-neighbor search wins three awards, up to 78x faster index building — khademinori · 2026-09-11
- Steerable Visual Representations Presented as ICML Long Oral — y_m_asano · 2026-09-11
- OpenCVL: a satellite-to-photo registration dataset at ECCV 2026 — ducha_aiki · 2026-09-11
- Diverse VPR work submitted to ECCV 2026 — ducha_aiki · 2026-09-11