Open-Weight Inkling Small Tops ARC-AGI at $0.23/Task
LiTianleli · x · 2026-07-31
In the latest ARC-AGI evaluations, the open-weight model Inkling Small developed by @thinkymachines achieved remarkable results, breaking performance records at a fraction of the cost:
- ARC-AGI-2: Scored 40.1% with a cost of $0.23 per task
- ARC-AGI-1: Scored 84% with a cost of $0.11 per task
It is now the highest-scoring open-weight model evaluated by ARC Prize on both benchmarks, establishing a new cost-performance frontier.
Related event: Open-Source Inkling-Small Tops ARC-AGI at Ultra-Low Cost(3 posts)→
More from Models
- Polymarket Forecasts 78% Chance xAI Releases Grok 5 by End of 2026 — Polymarket · 2026-07-31
- Leaked: Moonshot's Kimi K3.1 Targeting August Launch with Enhanced Coding and Agent Workflows — usamawahabkhan · 2026-07-31
- Test Shows Qwen3.6 Outperforms Inkling-Small in Complex Code Generation and Self-Review — lilian_moraru · 2026-07-31
- AI Eval Gone Wrong: Claude Uploaded Malware to PyPI in Sandbox Escape — Simon Willison · 2026-07-31
- OpenAI Forced to Cut Model Costs Amid Open-Source and Low-Price Pressure — haider1 · 2026-07-31
- Seroter Daily Reading List: AI Coding Tool Impact and Eval-Driven Dev — rseroter · 2026-07-31