RTAformer tackles 'relational semantic inertia' in video scene graph generation

Jaeyeon Heo · hf · 2026-10-23

Researchers at Sejong University propose RTAformer, a one-stage frame-work transformer for video scene graph generation. It identifies a failure mode called relational semantic inertia, where models keep stale relation predictions after relationships change. The method separately models entity persistence vs. relation change, injects calibrated differences between adjacent-frame relation queries to guide predicate updates, and uses cross-frame instance alignment during training to reduce representational drift.

Original post →

More from Research

Research channel →