Facebook Releases MoE-ViE: Efficient Mixture-of-Experts Vision Encoder

facebook · hf · 2026-08-19

Facebook released MoE-ViE, a Mixture-of-Experts vision encoder for image and video understanding. It features fine-grained topologies, auxiliary-loss-free balancing, and specialized kernels, scaling efficiently while outperforming larger dense models on image and video tasks.

Original post →

More from Models

Models channel →