Ben Todd pushes back: Epoch ECI is math-driven, so was Anthropic really behind on agentic coding?

ben_j_todd · x · 2026-11-22

Responding to herbiebradley's claim that Anthropic's acceleration starting in 2025 may exist precisely because it lagged OpenAI in 2025 and had to catch up, Ben Todd pushes back: were they actually behind on agentic coding?

He concedes OpenAI was better at math in 2025 and agrees the catch-up acceleration story is plausible, but argues the Epoch ECI benchmark is heavily math-driven at the top end, so it may not reflect the real agentic coding gap between the two labs.

Original post →

More from AGI Musings

AGI Musings channel →