Agnes-3.0-Flash beats Qwen on AA index, but nobody knows which model was tested
Aggressive_Aspect436 · reddit · 2026-09-13
A Reddit user dug into Agnes-3.0-Flash, a 33B model claiming to beat Qwen3.8 27B on the ArtificialAnalysis intelligence index, and found inconsistencies: the HF listing is marked "Preview" and explicitly states it is not the model AA evaluated; AA lists it as proprietary yet rates it above Qwen on "Openness"; and AA doesn't disclose the evaluated model's parameter count, so the two may share nothing architecturally. The community remains skeptical about the lab's intentions.
More from Models
- Altman: AI went from grade-school math to a Millennium Prize problem in 3 summers — rohanpaul_ai · 2026-09-13
- 'How to kill open source models in 3 steps' sparks debate on capture of AI safety rules — _jaydeepkarale · 2026-09-13
- DeepSeek V4.1 Flash lands on Together AI at one-third the cost per task — togethercompute · 2026-09-13
- A 101-parameter gate can silence Qwen3-4B without touching its answers — rayanpal_ · 2026-09-13
- Bindu Reddy: AI slowdown talk hands Google a catch-up window, Gemini 4.0 may be strong and dirt cheap — bindureddy · 2026-09-13
- OpenAI Teases "Hello, World" as Musk Camp Invokes Nonprofit Origins — KatieMiller · 2026-09-13