Massive open-weights MoE K2-Horizon-375B-A23B drops: 375B total, 23B active
HongyiWang10 · x · 2026-09-05
A new open-weights MoE model, K2-Horizon-375B-A23B, has been released with 375B total parameters but only 23B active per inference, targeting efficient large-scale text generation. The original author says the plan is to further post-train the model and release a diffusion variant as well.
Related event: MBZUAI's IFM Releases K2 Horizon: Six Fully Open Models from 0.9B to 375B(30 posts)→
More from Models
- Users want open-format export from Claude Docs as charts only save as images — BlackHC · 2026-10-20
- EMNLP study: LLM safety interventions drop up to 4.5x when distress is wrapped in delusion — MaartenSap · 2026-10-20
- Cybersecurity-focused VLM OrcaCyber-Nano-1.0 trends on Hugging Face — orcarouter · 2026-10-20
- 0.8B local model with 2,000 labels beats Jev's frontier API on banking data — kalyan_kpl · 2026-10-20
- New TTS benchmark tests 26 models across 30,564 requests: fastest at 46ms — mattturck · 2026-10-20
- Agents handle unreleased language Jai flawlessly, even compile-time execution — lucasmeijer · 2026-10-20