IFM open-sources K2 Horizon: six models from 0.9B to 375B with full training process
rohanpaul_ai · x · 2026-09-11
Institute of Foundation Models (IFM) released K2 Horizon, six open models from 0.9B to 375B spanning on-device models to reasoning, coding and agent models.
- Fully open: weights, training code, configs, data recipes, intermediate checkpoints, training logs and evals for every model, covering pre-training through agentic post-training
- Results: the 0.9B/3.7B/7B set new SOTA in their size classes; the sparse 36B-A4B activates only 4B params/token yet approaches the dense 32B
- Uses the new Mixture-of-Value Attention (MoVA), extending MoE routing into attention layers
- Each model trained on 20T tokens; checkpoints and logs give researchers an unusually detailed development record
- Also releasing xLLM, the production training infra, plus the full agentic post-training codebase including the RL pipeline
More from coding & agent
- Magic Patterns' first engineer: Cursor in Slack, a Patterson review agent, repo clones over worktrees — Y Combinator Blog · 2026-10-28
- Dev builds AI job-search app for his wife, she lands a job, and he open-sources it — CurieuxExplorer · 2026-10-28
- Supercharging LLM classification with logprobs: soft classifiers you can threshold-tune — JnBrymn · 2026-10-28
- Codex daily build series day 23: skipping iCloud plugins for a reset — dotey · 2026-10-28
- Cloudflare Access adds fully customizable pages with HTML + Liquid templates — dinasaur_404 · 2026-10-28
- Opus retried every session 20.6 million times during a memory leak hunt — johnlindquist · 2026-10-28