NeurIPS Paper Maps Where Temporal Context Belongs in Low-Resource Video Adaptation

HildeKuehne · x · 2026-11-03

A NeurIPS 2026 paper by Luc Sträter and Hazel Doughty systematically studies adaptation strategies for video foundation models under limited labeled data: should temporal context live in the backbone, PEFT adapters, or a probing head?

The study spans appearance-focused, motion-focused, and spatially dense tasks, comparing four allocation strategies (static backbone with temporal adaptation, temporal backbone with static adaptation, matched temporal context, and distributed temporal context). Key findings: video PEFT has mostly targeted image-pretrained models even though standard PEFT works on video representations too, and how temporal context is distributed across backbone, PEFT, and probe matters significantly for adaptation quality.

Original post →

More from Research

Research channel →