Qwen3.8-Max scores 19 on OpenRouter vs 26 on Alibaba — effort level bug suspected
PawelHuryn · x · 2026-09-12
Pawel Huryn spotted a suspicious score gap for Qwen3.8-Max: 19 via OpenRouter vs 26 via Alibaba directly. His prime suspect is the effort level not being served properly through OpenRouter, an issue he's seen before. He's running a probe to confirm and will update the thread in 50 minutes.
Related event: Qwen3.8-Max Scores Drop on OpenRouter as effort Parameter Fails(2 posts)→
More from Models
- Anthropic removes 5-hour usage cap for verified Claude Ultra subscribers — james_mtc · 2026-10-31
- DeepSeek's silent downtime upgrade caught by the pelican bicycle test — teortaxesTex · 2026-10-31
- ARC Prize 2026 closes in 3 days as Yi-Chia Chen tops ARC-AGI-3 at 75.56% — GregKamradt · 2026-10-31
- Fable 5.5 Max stuns with gorgeous SVG of a pelican riding a bicycle, headed to Claude Code — ChrisGPT · 2026-10-31
- OpenAI reportedly to train on users' Daybreak sessions with no opt-out — dyn___ · 2026-10-31
- NVIDIA Nemotron 3.5 scales LLM self-verification, +9-10 points on agentic benchmarks — sarahcat21 · 2026-10-31