Artificial Analysis ships Intelligence Index v4.3 with AutomationBench-AA
SonglinYang4 · x · 2026-09-08
- Artificial Analysis announced Intelligence Index v4.3
- Terminal-Bench upgraded 2.1 → 4.0; τ³-Banking replaced by AutomationBench-AA, an agentic workflow automation benchmark (based on Zapier's benchmark, with a private test set)
- Positioned as a partial rollout ahead of Index v5; each change stands on its own
- EdwardSun0909 comments: a model good across many measurements may simply be good, not benchmaxxing
Related event: Artificial Analysis Rolls Out Intelligence Index v4.3 with New Benchmarks(8 posts)→
More from Models
- User catches model failing to parse 400-paper file, citing stale news sources instead — jungofthewon · 2026-10-27
- Odd eval result: Gemini 4.1 Flash gets more accurate when asked to control its CoT — dfrsrchtwts · 2026-10-27
- Poster surprised that v4.1 flash gets more accurate when asked to control its CoT — dfrsrchtwts · 2026-10-27
- Dev claims Anthropic is baking 'sabotage' into model behavior for 'wrong' engineering — cephaloform · 2026-10-27
- Gemini fails at listing unread emails, tells user to search Gmail manually — gethackteam · 2026-10-27
- Meta's Muse Spark Open goes live on Applied Compute for async RL post-training — ypatil125 · 2026-10-27