VoiceMem: Shuicheng Yan's team builds a dual-brain memory system that remembers tone

jiqizhixin · x · 2026-09-17

Shuicheng Yan's team (AGI Being), with four universities and Open Interaction Lab, unveiled VoiceMem — a brain-like memory system for multimodal companion AI. Beyond storing what was said, it captures the emotional half: tone, pauses, hesitation. A streaming dual-brain architecture splits retrieval (left brain) from emotional memory (right brain), cutting post-VAD retrieval latency to 134ms (65% reduction) across four sub-stages. Benchmarked on LongMemEval, it aims to let companions build lasting trust instead of resetting every session.

Original post →

More from Research

Research channel →