AMD open-sources Instella 16B MoE with checkpoints from pretraining to RL
bronzeagepapi · x · 2026-07-25
AMD releases Instella 16B MoE as a fully open foundation model
AMD says Instella 16B MoE is its first MoE foundation model and its first built with FarSkip architecture.
- Checkpoints are published after every stage: pretraining, long-context, SFT, DPO, and RL.
- The team also released dataset details, training recipes, and code for reproducibility.
- The post frames this as a fully open release rather than a partial demo or teaser.
More from Models
- Bug Hunt Bench ranks frontier coding models on 105 planted real-repo bugs — PawelHuryn · 2026-09-11
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- 105 hidden bugs, 2 repos: DeepSeek V4.1 Flash fixes 24 at $1.80 vs Opus 5's 27 at $51.33 — ChartsJournalX · 2026-09-11
- awesome-llm-leaderboards: an open-source directory of LLM leaderboards, pricing tables, comparison tools — Last_Establishment_1 · 2026-09-11
- Anthropic claims it works to keep eval environments unidentifiable to models — MaxKannen · 2026-09-11
- Nex N2.5 Pro released on Hugging Face with 407GB of weights — jinnyjuice · 2026-09-11