AAI Index #4 Kimi 3.1 Pro badly underperforms MiMo 2.6 and DeepSeek 4.1 Flash in real use
PerformanceRound7913 · reddit · 2026-10-25
A Redditor reports that the Artificial Analysis Index doesn't reflect real-world performance: Kimi 3.1 Pro, ranked #4 on AAI and tested via OpenRouter, falls well short of MiMo 2.6 and DeepSeek 4.1 Flash in actual use cases. The author argues the AAI index is very easy to game and its rankings don't track real usage quality.
More from Models
- Open-source DNA model Carbon-X (14.8B) nears frontier scores on genomics at 1/1800th the cost — aigclink · 2026-10-25
- MemT 1.0: 293B memory-native MoE puts persistent memory inside the forward pass — AKAMA199 · 2026-10-25
- GPT-X3-150M tops Open SLM Leaderboard, dethrones SmolLM2-135M with GDN2/GQA hybrid — datdanboi25 · 2026-10-25
- Apple's on-device Foundation Model tested: 45/49 on routing, but easily prompt-injected — NellWatson · 2026-10-25
- Blind test of 5 local AI agents on one Qwen model: scores range from 3/5 to 5/5 — GapNew4766 · 2026-10-25
- DLSS 5 works stunningly on 25-year-old FFXI despite almost no training data — eschadiol · 2026-10-25