OVH announces Olala mini: 7B MoE with 1B active params, Apache 2.0 open source

clem844 · reddit · 2026-11-17

French cloud provider OVH announced Olala mini, a MoE model with a 7B-parameter architecture and 1B active parameters spread across 256 experts per layer, using hybrid attention (Differential-TPA + Mamba-3) in BF16. Only a fraction of the model activates per request, making it fast and memory-light.

Performance:

Will be released as open source on Hugging Face under the Apache 2.0 license.

Related event: OVH Releases First In-House Open-Source MoE Model Olala mini(2 posts)→

Original post →

More from Models

Models channel →