Tencent Releases WeMM-Video: Omni MLLMs from 2B to 35B-A3B

ExponentialCookie · reddit · 2026-11-20

Tencent released WeMM-Video, a family of omni multimodal LLMs in accessible sizes (2B, 4B, 9B, 35B-A3B), with the paper on arXiv (2611.26409).

The models combine video frames with the original soundtrack to describe events, transcribe speech, and reason over what is seen and heard; they also accept silent video, standalone audio, images, and text, responding in Chinese or English. Vision and audio encoders turn media into tokens processed by the LM, with timestamped video frames. Pretraining used 1.2 trillion multimodal tokens, followed by multi-teacher OPD, anti-repetition MrDPO, and specialist RL.

Related event: Tencent and Tsinghua Open-Source WeMM-Video Omni-Modal Video Models(2 posts)→

Original post →

More from Multimodal

Multimodal channel →