Kimi K3 posts top AA-Briefcase results, but costs $10.57 per task and 56.4 minutes
ArtificialAnlys · x · 2026-07-22
Kimi K3 shows very strong frontier performance on AA-Briefcase, but at a heavy runtime and cost penalty.
- Average time per task is 56.4 minutes, among the highest recorded on the benchmark.
- The long wall-clock time is driven by 83 turns per task and about 120k output tokens per task, both well above Kimi K2.6.
- The model's cost per task is $10.57, one of the highest on the leaderboard.
- Compared with rivals, GPT-5.6 Sol (max) is 42 Elo lower while costing about 50% less, and Grok 4.5 (high) is 220 Elo lower while costing about 90% less.
Related event: Kimi K3 Scores High on AA-Briefcase but Incurs High Costs and Long Runtimes(5 posts)→
More from Infra
- Unsloth releases GGUF quantizations for Laguna S 2.1 — BoogerheadCult · 2026-07-22
- Nuclear power could shape AI buildout after 2028, with China and the U.S. dominating 2050 capacity — tengyanAI · 2026-07-22
- Mark Cuban says cheaper AI could leave data centers empty enough for pickleball — AIFlow_ML · 2026-07-22
- Dongfang Computing Core’s DF1000 chip claims 520 TFLOPS BF16 and 6.4 TB/s bandwidth — teortaxesTex · 2026-07-22
- QuixiAI shows the same runtime spanning CUDA, Metal, ROCm, XPU, Gaudi and CPU — QuixiAI · 2026-07-22
- Meta infra is accused of wasting silicon on local wins that cost billions — dylan522p · 2026-07-22