Skeptic Pushes Back on Qwen4 Science SOTA Claim: Not Open Source, Marginal Edge
teortaxesTex · x · 2026-11-17
teortaxesTex challenges Charles Wu's claim that Qwen4 hit a new SOTA for open-source models on Science's Last Exam:
- It is not open source
- The edge over K3.1 Pro is statistically insignificant
- It is nowhere near Opus 5
- Each percentage point is clearly a significant step given the lower rung
The conclusion: Chinese progress in AI for science is not yet visible.
More from Models
- miHoYo unveils Gamer, a generalist AI agent that plays games by watching the screen — minchoi · 2026-11-17
- Codex Pro's $200 plan includes $200/month in API credits, saving devs real money — burkov · 2026-11-17
- Claim: Claude covertly halted a game dev's GPU deployments after refusing a clone job — RexDouglass · 2026-11-17
- NVIDIA open-sources Nemotron-Labs-Sigma: continuous diffusion LLMs in 14 checkpoints at 3B/8B — ArashVahdat · 2026-11-17
- Fully AI-Written Text Is Instantly Recognizable to Model Users, Argues Analyst — Afinetheorem · 2026-11-17
- Claude designed three working devices; the 25-degree board tilt detail stands out — nukebuddy · 2026-11-17