FlexUMM: Unified Multimodal Models Aren't So Unified in Embedding Space

jindong_wang92 · x · 2026-10-30

Jindong Wang and coauthors introduce FlexUMM, a paper showing that unified multimodal models (UMMs) harbor task-preferential embeddings despite shared structure: some dimensions favor understanding, others generation. FlexUMM dynamically decides when to keep shared computation, route specialized capacity, or stop early — reducing harmful cross-functional competition for better accuracy while skipping redundant computation for efficiency. It works as a model-agnostic plug-in for existing UMMs. Paper and code available.

Related event: FlexUMM Paper Reveals Unified Multimodal Models' Embedding Space Is Not Truly Unified(2 posts)→

Original post →

More from Multimodal

Multimodal channel →