OVH launches first in-house LLM family: Olala mini 7B with 1B active params, runs on 8GB GPUs

jedisct1 · x · 2026-11-17

French cloud provider OVH has announced Olala, its first LLM family, debuting with Olala mini 7A1B — a 7B-parameter model with 1B active params spread across 256 experts per layer, using hybrid attention with Differential-TPA and Mamba-3 in BF16.

Only a fraction of the model activates per request, so it runs on any GPU with 8GB+ VRAM: 160 tokens/s on an RTX A4500 and 50 tokens/s on a plain CPU, with a 32K-token context window. A promotional comic claims training costs dropped 20x since 2023 and that European search engine Qwart has adopted it. It will be open-sourced on Hugging Face.

Related event: OVH Releases First In-House Open-Source MoE Model Olala mini(2 posts)→

Original post →

More from Infra

Infra channel →