Artificial Analysis Intelligence Index v4.3 raises private-question weight to 45%
ArtificialAnlys · x · 2026-09-08
Artificial Analysis published the methodology for Intelligence Index v4.3:
- Category weights unchanged: Agents 30%, Coding 20%, General 30%, Scientific Reasoning 20%
- Terminal-Bench 4.0 keeps the same weighting as 2.1, with AutomationBench-AA replacing 𝜏³-Banking at its 5% weight
- Evaluations with private questions/answers now account for 45% of the weighting, up from 40% in v4.2, reducing benchmark contamination risk
Full results and methodology are available on the Artificial Analysis site.
Related event: Artificial Analysis Rolls Out Intelligence Index v4.3 with New Benchmarks(8 posts)→
More from Models
- Poster surprised that v4.1 flash gets more accurate when asked to control its CoT — dfrsrchtwts · 2026-10-27
- Dev claims Anthropic is baking 'sabotage' into model behavior for 'wrong' engineering — cephaloform · 2026-10-27
- Gemini fails at listing unread emails, tells user to search Gmail manually — gethackteam · 2026-10-27
- Meta's Muse Spark Open goes live on Applied Compute for async RL post-training — ypatil125 · 2026-10-27
- Moonshot curbs hacking ability in Kimi K3.1 Pro, its strongest 3T-class open-weight model — pstAsiatech · 2026-10-27
- Would you want an argumentative LLM that never backs down, even under prompt injection? — GodComplecs · 2026-10-27