FrameMorrow Selects History Frames by Predicted Future Needs, Boosting 11 Long-Video Generators

NationalUniversityofSingapore · hf · 2026-10-05

NTU Singapore proposes FrameMorrow for long-horizon video generation: existing methods judge historical relevance from current content, but seemingly irrelevant history may matter later.

Method: predict a small set of prospective tokens representing future information needs, and use them to select relevant explicit history frames—rather than model-internal states—enabling plug-and-play integration even with closed-source generators at little extra inference cost.

Results: Evaluated across 5 benchmarks and 11 generators (long-video, interactive generation, action-conditioned world models), consistently improving long-range consistency, visual quality, and action alignment.

Original post →

More from Multimodal

Multimodal channel →