Korean Company Motif Releases 314B MoE Open-Weight Model, Rivals DeepSeek V4 Pro
eliebakouch · x · 2026-07-21
Korean company Motif releases Motif 2.6B tech report, a 13B active 314B total MoE model, performing on par with Minimax M3 and DeepSeek V4 Pro. It features differential attention (GDLA), per-expert activation function polynorm, modified mHC. Trained on 2.5T tokens with data mixture scheduling and WSD. Fine-tuning uses EvolKit and dataset fusion.
Related event: Korea's Motif Releases Motif-3 Beta with 314B Parameters on Hugging Face(4 posts)→
More from Models
- OpenCodex turns OpenAI’s Codex harness into a multi-provider coding workflow — arrakis_ai · 2026-07-21
- A user says Claude 4.6 felt worse yesterday and asks whether model quality can drift over time — Rahios · 2026-07-21
- Researchers debate whether GPT-OSS ever had a clear harm case — aiamblichus · 2026-07-21
- Kimi K3 hits 89.4% peak on software tasks while Fable 5 is slightly steadier — FinanceYF5 · 2026-07-21
- Kimi K3 leads on Go, but Fable 5 wins Python, JavaScript, TypeScript and Rust — FinanceYF5 · 2026-07-21
- Kimi K3 reaches 89.4% pass@4 and tops the benchmark over GPT-5.6 Sol — FinanceYF5 · 2026-07-21