Artificial Analysis Intelligence Index v4.3: Terminal-Bench 4.0, Zapier's AutomationBench
SteppenAxolotl · reddit · 2026-09-08
Artificial Analysis shipped Intelligence Index v4.3, upgrading Terminal-Bench to 4.0 (66 multi-step terminal tasks, now on mini-SWE-agent) and replacing τ³-Banking with AutomationBench-AA, a 657-task private business-workflow benchmark built on Zapier's set, lifting private-test weight to 45%. Claude Fable 5.1 and GPT-6 Astra tie at 53; GLM-5.3 and Kimi K3 lead open weights at 44; OpenAI dominates the cost-efficiency frontier.
Related event: Artificial Analysis Rolls Out Intelligence Index v4.3 with New Benchmarks(8 posts)→
More from Models
- GPT-6.1 Terra rolls out to all Plus, Pro, Enterprise and Edu users — OpenAI · 2026-10-27
- OpenAI launches GPT-6.1 Terra with 50% lower API prices than GPT-5.6 Terra — OpenAI · 2026-10-27
- In cyber, intention matters little: Chintala on model info leaks, and what users should do — brhydon · 2026-10-27
- Why don't more LLMs ship 10M-token context? A researcher asks about attention tradeoffs — agarwl_ · 2026-10-27
- Ortet's first health eval: 34 open-weight models, 50 tasks, generic rankings fall short — thegautamkamath · 2026-10-27
- VLM Run launches OCR Playground for side-by-side comparison of GLM-OCR, DeepSeek-OCR-2 and more — spillai · 2026-10-27