Qwen's Junyang Lin: there's no deterministic way to judge a base model's potential
JustinLin610 · x · 2026-11-18
Junyang Lin (JustinLin610) of Alibaba's Qwen team says the old trick of light SFT followed by benchmarks still over-indexes on post-training benchmark scores instead of assessing a base model's underlying potential—its knowledge and reasoning sharpness. He argues there is no deterministic way to solve this evaluation problem.
Related event: Qwen's Lin: Lightweight SFT Benchmarks Can't Reveal Base Model Potential(2 posts)→
More from Models
- Google AI Mode now enforces usage limits, users surprised by rate-limit popup — elvano124 · 2026-11-22
- Sol 6.2 now refuses reverse engineering that Sol 6.1 happily did for a month — cardak98 · 2026-11-22
- Anthropic's record ~$81B IPO, GPT-6.2 pricing, Qwen4-Max and Copilot Autopilot: week in review — ksraj1001 · 2026-11-22
- Reddit rant: Frontier AI labs are training models to imitate lazy engineers — RossPeili · 2026-11-22
- MBZUAI open-sources PAN 2, a 29B-parameter general-purpose world model — LinusEkenstam · 2026-11-22
- Inkling Mini turns out surprisingly fluent in Russian, sparking data recipe questions — teortaxesTex · 2026-11-22