Stripe finds coding agents meet 78% of criteria but fully pass only 29% of integration runs

emilygsands · x · 2026-11-20

Stripe tested coding agents on real Stripe integrations and found they meet on average 78% of criteria, with only 29% of runs satisfying every required criterion — close, but often not all the way there.

Related event: Stripe Open-Sources Agent Evals: Only 29% of Coding Agents Fully Pass(5 posts)→

Original post →

More from coding & agent

coding & agent channel →