Whareformer: A New Architecture for Object Tracking in Long Egocentric Videos

dimadamen · x · 2026-07-10

Whareformer is designed to tackle object tracking (OSNOM) in long egocentric videos, explicitly retaining objects that leave the field of view in its memory. By combining appearance and 3D position discrepancies, and utilizing new trajectory tokens for online learning and memory updates, the model effectively handles the challenge of re-identifying objects after prolonged absences.

Related event: Whareformer: A New Approach for Online Object Tracking in Long Egocentric Videos(6 posts)→

Original post →

More from Research

Research channel →