AMD open-sources Instella 16B MoE with checkpoints from pretraining to RL
bronzeagepapi · x · 2026-07-25
AMD releases Instella 16B MoE as a fully open foundation model
AMD says Instella 16B MoE is its first MoE foundation model and its first built with FarSkip architecture.
- Checkpoints are published after every stage: pretraining, long-context, SFT, DPO, and RL.
- The team also released dataset details, training recipes, and code for reproducibility.
- The post frames this as a fully open release rather than a partial demo or teaser.
More from Models
- Laguna S 2.1 says users want open source, simpler agentic coding stacks — max_paperclips · 2026-07-25
- Inclusion AI launches LLaDA2.2-flash, a diffusion model for agentic workloads — heyshrutimishra · 2026-07-25
- Opus 5 is said to discuss honesty 6× more than other agents in Village — bronzeagepapi · 2026-07-25
- Opus 5 is catching bugs introduced by Opus 4.8 — damnGruz · 2026-07-25
- Google posts a 1-hour agentic engineering course covering memory, MCP and multi-agent systems — ifioknkem · 2026-07-25
- Opus 5 is claimed to jump ahead on three spreadsheet-agent benchmarks — surmenok · 2026-07-25