GitHub publishes harness-level data comparing Copilot CLI vs Codex and Claude Code

0xkarasy · x · 2026-11-18

GitHub now publishes data on how the GitHub Copilot harness performs relative to other harnesses including Codex CLI and Claude Code CLI, supplementing existing model benchmarks on Terminal Bench 4.0 and DeepSWE 1.1. The chart plots resolution rate vs. avg cost per task: Claude Opus 5.5 and GPT-6 Astra lead (45-50% at $2.5+), GPT-6.1 Sol hits 47% at $0.5, Claude Sonnet 5.5 28%, while GPT-6 Luna is cheapest but under 10% resolution. Harness choice matters less than model choice.

Original post →

More from coding & agent

coding & agent channel →