IFM's K2-Horizon: six open models up to 375B MoE, with data and training code

winer666 · reddit · 2026-11-18

IFM (the institute behind MBZUAI, Abu Dhabi) released K2-Horizon: six open models from a 0.9B dense model to a 375B-A23B MoE flagship. The standout is the openness package — alongside weights: pretraining corpus, stage checkpoints, training logs, eval code, the xLLM training stack, and RL360 post-training code, framed as "glass box, not black box." Four models share a 22T-token corpus, with 10T synthetic pretraining tokens documented.

Technical notes from the paper (arXiv 2611.21003):

Caveats: a 375B MoE is infra news, not a laptop download; benchmark claims need independent runs; Abu Dhabi origin means checking data-residency/export rules. Available via vLLM, SGLang, Ollama. The open question: does shipping data and training code redefine "open" for the next frontier releases?

Related event: IFM Open-Sources K2-Horizon Fleet up to 375B(3 posts)→

Original post →

More from Models

Models channel →