Beam Scores 28 on Coding Agent Index, 40 Behind Leaders but Among Most Token-Frugal
ArtificialAnlys · x · 2026-10-16
Artificial Analysis ran Beam in Reflection's open-source CLI harness Mirror: it scores 28 on the Coding Agent Index — 15 points behind the next setup (Claude Code with Qwen3.8 Max at 43) and 40 behind the leaders (68).
It is, however, very frugal: only Codex with GPT-6 Astra and Codex with GPT-6.1 Sol use fewer tokens. Token breakdown: of 26k output tokens per Intelligence Index task, 19k go to reasoning and 7k to answers — only 26% of output is final answers, the 28th-lowest share among 219 models tested.
More from coding & agent
- Isolating Antigravity chats per subfolder with AGY Rules and PreInvocation Hooks — bibryam · 2026-10-16
- Gemini shown off modding Minecraft to turn players into any Spider-Man — zacharynado · 2026-10-16
- Workflow: annotate UI screenshots in tldraw, hand to Claude, get better UI — max__drake · 2026-10-16
- Beyond chat wrappers: designing stateful, multimodal AI apps as interaction conductors — dr_cintas · 2026-10-16
- IBM engineer maps 5 levels of AI coding, from manual to a 3-day agent software factory — TejasKumar_ · 2026-10-16
- 10 open-source repos that let your AI agent reverse-engineer apps and games — victor_explore · 2026-10-16