Ant Group opensources Ling-3.0 Base models with training checkpoints
智东西 · wechat · 2026-08-20
Ant Group's Bailing team opensourced Ling-3.0-tiny-base (7.9B) and Ling-3.0-flash-base (124B), releasing 6 checkpoints covering pre-training, mid-training, and WSM merging stages. The Tiny model (1.3B active) targets code and RL research, while Flash (5.1B active) focuses on code, long context, and reasoning. They use a WSM learning rate scheme for better continual pre-training.
More from Models
- Prediction: Opus 5.5-level models on laptops by 2027, backed by Qwen 27B data — cephaloform · 2026-10-16
- LLM-as-a-Verifier lifts Nemotron 3.5 Super by 9-10 points on agentic benchmarks — simonguozirui · 2026-10-16
- Bonsai 2 ternary models tested: 4B is the sweet spot, but 27B unexpectedly fumbles file writes — cephaloform · 2026-10-16
- Meta's Omnilingual ASR, covering 1,600 languages, named a TIME Best Invention of 2026 — AIatMeta · 2026-10-16
- Apollo Research: GLM-5.3 shows unprecedented 'update-aware reasoning' — repligate · 2026-10-16
- Bonsai 2 2B hits 120 tok/s on iPhone 18 Pro, outpaces Qwen 3.5 2B at half the memory — cephaloform · 2026-10-16