China's StepFun releases Step 5 Preview weights: 600B MoE, 27B active, 1M context
Dr_Singularity · x · 2026-10-15
StepFun has released the weights for Step 5 Preview: a 600B-parameter MoE with 27B active per token, a 1M-token context window, and native support for text, images and video. Built for agents tackling long coding and research tasks, it can compress its progress and keep going when the context fills up — notable as a China-side release on a day with no new Western model news.
Related event: StepFun Open-Sources Step 5 Preview: 600B MoE with 1M Context(16 posts)→
More from Models
- Opus 5 might be a very deep model or use looping, commentator speculates — scaling01 · 2026-10-16
- GPT-6.1 Sol audit finds 6% of arXiv papers had false main theorems, down to 1.5% recently — nitarshan · 2026-10-16
- Nvidia-backed post-training pushes Nemotron 3.5 VL past frontier on dermatology diagnosis — LoganGrasby · 2026-10-16
- Gemini 4 Argon scores 97.5% on ARC-AGI-3, second lab above 95% — patience_cave · 2026-10-16
- Microsoft MAI claims SOTA 3T-param in-house base models, post-training results coming — soldni · 2026-10-16
- Datadog's Scout 1.0: post-trained GLM-5.3 Flash matches frontier models for AI SRE at lower cost — Tim_Dettmers · 2026-10-16