Open MOSS Open-Sources Real-Time Multimodal Model
AdinaYakup · x · 2026-07-19
Open MOSS has open-sourced MOSS-VL-Realtime, which is now available on Hugging Face. This 11B model family supports text, single/multiple images, single/multiple videos, and interleaved image-text inputs, covering both Chinese and English scenarios.
The project highlights several design choices: using Cross-Attention to separate visual encoding from language reasoning, applying XRoPE for unified spatiotemporal positional encoding, providing a unified conversation template applicable for offline/streaming/real-time interactions, and supporting a 256K token context. It can also continue processing new frames while generating a response, modifying or interrupting its answer based on scene changes, and even remaining silent when evidence is insufficient.
More from Multimodal
- Hi3D V1.0 open-sourced with 2M training assets and 90% slicing success rate — kimmonismus · 2026-10-26
- Claude Can Replace Your YouTube Thumbnail Designer in 10 Minutes — thedankoe · 2026-10-26
- Multimodal AI Is Not Useless: A Practitioner Pushes Back on Growing Skepticism — thoma_gu · 2026-10-26
- One prompt, full Blender animation: dev says he never touched Blender once — iamfakhrealam · 2026-10-26
- Dense instance segmentation via Muse Wonder + SAM 3.1 on Meta's Model API — nikhilaravi · 2026-10-26
- LichtFeld Studio v0.5.4.3 ships community-built SteadySplats, POPSpa and Voxelization — janusch_patas · 2026-10-26