NWPU's ROSE framework (NeurIPS Spotlight) curbs forgetting in lifelong multimodal knowledge editing
机器之心 · wechat · 2026-11-21
A team at Northwestern Polytechnical University (advised by Profs. Song Lingyun and Shang Xuequn) presents ROSE, a lifelong knowledge-editing framework for multimodal LLMs accepted as a NeurIPS 2026 Spotlight, targeting catastrophic forgetting (new edits overwriting old ones) and locality erosion (updates damaging unrelated knowledge and pretrained abilities).
ROSE freezes the backbone and writes new facts into an auxiliary branch on the FFN down-projection: gradients are projected onto the orthogonal complement of historical edit subspaces to avoid conflicts, plus a dynamic risk mask limits which parameters update. At inference, visual/textual semantic prototypes gate whether an input touches edited knowledge, fusing branch features only where differences are significant.
After 1000 sequential edits on LLaVA-v1.5-7B in VLKEB, ROSE keeps 95.24% reliability (FT-L drops to 68.14%), beats LiveEdit on textual (92.74%) and multimodal (84.53%) generalization, and reaches 100% textual / 88.39% multimodal locality; single edits take 1.31s on one RTX 4090. Paper and code are open-sourced.
More from Research
- Ramez Naam extrapolation: AI a decade away from completing 98% of hour-long human tasks — GaryMarcus · 2026-11-21
- Colgate paper: LLM roleplay hits 90% of human test-retest reliability in purchase-intent research — 2C_ornot2C · 2026-11-21
- Riemann Hypothesis proof gets full formal verification, experts call it 'very human math' — Kyrannio · 2026-11-21
- Claims surface: Navier-Stokes and Riemann proofs via LEAN, by OpenAI and Claude — BasketVolleyball11 · 2026-11-21
- Hassabis predicted 2 years for AI to crack a Millennium Prize problem; 6 months later, both Riemann and Navier–Stokes have proposed solutions — Hesamation · 2026-11-21
- GPT-2 'sleep' replay from a frozen snapshot keeps 58% of old facts vs 6% without — Junior_Reputation639 · 2026-11-21