Artificial Analysis Accused of Tweaking Weights to Suppress Open-Source Models
Infinite-Local5435 · reddit · 2026-08-07
A user raised concerns about the impartiality of Artificial Analysis (AA) leaderboards. Previously, the open-source Qwen 3.8 max topped the platform's Agentic Index.
The user noted that AA subsequently released version "v4.1.1" of the index, adjusting the weights of benchmarks like gdpval and t3 banking to lower the open-source model's score below Anthropic's Opus. The user suspects foul play, implying the weight adjustments were made to favor proprietary models for commercial reasons.
More from Models
- Opus 5.5 turns heads with surprisingly polished vertical video demo — FinanceYF5 · 2026-10-16
- Astra 6.1 may arrive before end of month, reads dev's 'we are cooking' tease — haider1 · 2026-10-16
- Open-source OCR model indra-ocr trends on Hugging Face with CPU support — datalab-to · 2026-10-16
- Xiaohongshu's Vela 35B turns anonymized user behavior into supervision, gains +11.5 on VelaBench — AdinaYakup · 2026-10-16
- KOL: No better model than Anthropic's Opus right now, its magic is back — kimmonismus · 2026-10-16
- Users blast Gemini in Chrome's 'draconian' usage caps: memory costs 2-4% per use — North-American · 2026-10-16