Agent harness benchmark: Codex, Hermes Agent, Command Code tie at 21/29
Teknium · x · 2026-09-17
A composio benchmark compared six agent harnesses on task success rate: Codex, Hermes Agent, and Command Code tied for the lead at 21/29, with Claude Code one task behind and OpenCode and Pi Agent at 19/29.
- The overall spread was only about 7 percentage points.
- Only 3 of 29 tasks produced different results across harnesses: 18 passed everywhere, 8 failed everywhere.
- Teknium (Nous Research) called Hermes Agent top-tier on accuracy, cost, and speed.
More from coding & agent
- Diorama gives OpenAI Codex coding agents a visual office you can watch work in real time — davidfromkansas · 2026-09-17
- Code-first, UI on top: building bespoke brand design tools with AI — floguo · 2026-09-17
- Study of 7 models across Claude Code, Codex, Pi: harness barely affects success but swings cost — DavideCrapis · 2026-09-17
- AI trading bot built with Jev is down 85%, owner shrugs it off — generativist · 2026-09-17
- Redditor's 3-Day SoL-Pi Test: Memory Objects Save ~12k Tokens Per Tool Run — Garblyx · 2026-09-17
- Reviewing AI code through Steve Jobs' lens: unseen internals deserve beauty too — sergeykarayev · 2026-09-17