Motif-3-Beta lands on Hugging Face with 314B total params and 256K context
_akhaliq · x · 2026-07-21
Motif-3-Beta has landed on Hugging Face with clear long-context and MoE details:
- 314B total parameters, with 13B active per token
- 256K native context length (262,144 tokens)
- Sparse MoE routing with 384 experts, 8 activated per token, plus 1 shared expert
- Positioned as a multilingual, general-purpose model
Related event: Korea's Motif Releases Motif-3 Beta with 314B Parameters on Hugging Face(4 posts)→
More from Models
- Moonshot’s Kimi K3 sets a new open-weights ECI record at 156 — scaling01 · 2026-07-22
- Nanbeige4.2-3B launches as a 3B Looped Transformer model that beats larger baselines — Wooden-Deer-1276 · 2026-07-22
- A post says six companies now beat Google’s best LLM, including two open-source models — soham_btw · 2026-07-22
- Gemini 3.6 Flash benchmark results reignite concerns that Google is slipping behind — minxio_ · 2026-07-22
- Gemini 3.5 Flash Lite Tested: Not Frontier-Optimal, but Hits 350 tok/s — brandon_galang · 2026-07-22
- Benchmark scorecard pits GPT-5.6 Sol, Claude Fable 5, and Gemini 3.6 Flash — iruletheworldmo · 2026-07-22