Kimi K3 hits 89.4% peak on software tasks while Fable 5 is slightly steadier
FinanceYF5 · x · 2026-07-21
Kimi K3 and Fable 5 reach a per-task correlation of 0.72, the highest cross-vendor similarity reported here. The analysis says no task produced a perfect 4/4 split where one model always passed and the other always failed, suggesting the benchmark may be saturating.
Kimi K3 reaches a peak score of 89.4%, with 76.6% stable solve rate and 45 tasks solved all four times. Fable 5 is slightly more stable at 79.0%, with 58 tasks solved four times in a row. The accompanying plot shows Kimi has the widest overall reach in the dataset at 89.4% coverage.
Related event: Kimi K3 Matches Fable 5 in SWE Benchmarks at a Third of the Cost(7 posts)→
More from Models
- Artificial Analysis breaks down all sub-evaluations in Intelligence Index v4.3.2 — ArtificialAnlys · 2026-10-27
- GPT-6.1 Terra gains ~20 points on Terminal-Bench 4.0, rivalling GPT-6.1 Sol — ArtificialAnlys · 2026-10-27
- GPT-6.1 Terra cuts hallucination rate by 50 points while lifting accuracy 2 points — ArtificialAnlys · 2026-10-27
- GPT-6.1 Terra scores 48 on AA Coding Agent Index at one-third the cost of GPT-5.6 Terra — ArtificialAnlys · 2026-10-27
- Leaked Terminal-Bench 4.0 chart shows GPT-6.1 Terra leading at lowest cost, unverified — Angaisb_ · 2026-10-27
- OpenAI brings GPT-6.1 Terra to the API and Codex for fast, cheap computer use — OpenAIDevs · 2026-10-27