Ai2 Open-Sources Olmo-core 3, a Trillion-Parameter MoE Training Stack

On October 1, Allen Institute for AI (Ai2) released and open-sourced Olmo-core 3, the core training system for the next-generation OLMo, designed to scale MoE (mixture-of-experts) training to trillion-parameter scale while keeping compute efficient, continuing Ai2's commitment to open-sourcing all training tools and infrastructure.

Confirmed

Why it matters

2026-10-01 ~ 2026-10-03 · 5 related posts

Primary sources

1 near-duplicate retellings: lmoroney