NeoMME: 260M/800M multimodal-native multilingual encoders drop the vision tower

antoine_chaffin · x · 2026-09-04

Researcher tonywu71 introduces NeoMME, a family of 260M and 800M multimodal-native, multilingual efficient encoders. A single bidirectional Transformer processes both text tokens and raw image patches — with no pretrained vision tower, text encoder, or decoder. NLP researcher bclavie and others amplified it, calling it impressive, thorough work that outperforms what they'd have designed for image encoders.

Related event: NeoMME: single-tower multimodal multilingual encoders launched, 260M tops ViDoRe v3 under 800M(7 posts)→

Original post →

More from Multimodal

Multimodal channel →