Stripe's model-run shop bench: 5 of 7 working stores built by Claude

bcherny · x · 2026-09-16

Stripe launched UnseriousT-ShirtShopBench, asking models to build and run online t-shirt stores. Every model chose to integrate Stripe on its own.

Of the 7 functional shops, 5 were built by Claude-family models, and the 2 finalists picked for production were built by Fable and Opus. The author (a Stripe engineer launching the Breaking Change Substack) concludes models still have a way to go before running full e-commerce operations autonomously.

Related event: Stripe's T-Shirt Shop Benchmark: Only 7 of 21 Model Runs Produced a Working Store(7 posts)→

Original post →

More from coding & agent

coding & agent channel →