Open MOSS Open-Sources Real-Time Multimodal Model
AdinaYakup · x · 2026-07-19
Open MOSS has open-sourced MOSS-VL-Realtime, which is now available on Hugging Face. This 11B model family supports text, single/multiple images, single/multiple videos, and interleaved image-text inputs, covering both Chinese and English scenarios.
The project highlights several design choices: using Cross-Attention to separate visual encoding from language reasoning, applying XRoPE for unified spatiotemporal positional encoding, providing a unified conversation template applicable for offline/streaming/real-time interactions, and supporting a 256K token context. It can also continue processing new frames while generating a response, modifying or interrupting its answer based on scene changes, and even remaining silent when evidence is insufficient.
More from Multimodal
- Fish Audio ships open-weight Drama 3 TTS; creator shows turning old posts into narrated videos — alex_verem · 2026-10-27
- Redditor crafts photorealistic 'morning bus ride' short film entirely in ComfyUI — no3us · 2026-10-27
- New blur/anti-blur slider LoRA for MOSS lets you dial background sharpness with weights — NoMouse9610 · 2026-10-27
- PixGR: Pixel-space generative decoding for fast feed-forward 3D reconstruction — kwangmoo_yi · 2026-10-27
- Krea-2 Turbo + ComfyUI for product ads: prompts and results shared — comfy-king-999 · 2026-10-27
- High-res tiled Marigold V2 depth maps arrive in ComfyUI with See Through model — AntonObukhov1 · 2026-10-27