Mollick: Qwen 27B is a great local model but nowhere near rivals on agentic tasks
emollick · x · 2026-08-19
Wharton professor Ethan Mollick pushed back on the claim that Qwen 27B is open source's "DeepSeek moment": while it's a really good local model, when you actually use it, it's immediately and obviously far behind the other models on the leaderboard for agentic tasks — especially the complex tasks GDPval-AA purports to measure. His advice: do your own benchmarking rather than trusting the narrative.
More from Models
- Researcher: GPT 5.6 Sol Ultra Beats Pro for Long-Horizon Hard Problems — arankomatsuzaki · 2026-08-24
- Google Criticized: Gemini 3.7 Still Missing From Its Own Jules Agent a Week Later — brandon_galang · 2026-08-24
- Qwen 27B 3.8 low quantization tested: Q3 XXS works well locally — jeremyckahn · 2026-08-24
- Users notice significant quality shift in GPT-5.6 output — haider1 · 2026-08-24
- Ramp Stats: Anthropic Opus 4.8 and Sonnet 4.6 Lead Usage — vista8 · 2026-08-24
- Tencent Releases UI-Mate-27B, a Desktop GUI Agent Model — tencent · 2026-08-24