Qwen-Max Benchmark Scores Fluctuate: Drops to 53 on First Run
teortaxesTex · x · 2026-08-13
Developers noticed fluctuations in Qwen-Max's benchmark scores, scoring 53 on the first run (previously 56 before rescaling, and currently 58).
Cited discussions speculate this might mirror previous Qwen 3.8 Max update strategies, where an initially mediocre checkpoint was released and quietly updated to perform much better a few days later.
More from Models
- OpenAI Voice Update Adds French, German, Hindi, Korean, Japanese Voices and Naturaler Preambles — shaunralston · 2026-10-16
- Why aren't labs training on hundreds of millions of videos for native audio/video? — imjustnewatai · 2026-10-16
- ChatGPT UI screenshot reveals Wallet coming soon plus Email, Calendar, Health and Finances integrations — jxnlco · 2026-10-16
- Why the next OpenAI and Anthropic models may still disappoint: no native audio or video input — imjustnewatai · 2026-10-16
- Thousands Hit by ChatGPT Standard Voice Mode Regression: Wrong Voice, Interruptions — shaunralston · 2026-10-16
- Gemini Argon 4 Quota Exhausted, Reset Countdown Shows Nearly 7 Days — ssh4net · 2026-10-16