Sonnet 5.5 (max) long-horizon agent runs: 1,833 turns, 6.5 hours, $192 with score dropping

PawelHuryn · x · 2026-09-30

PawelHuryn published a third long-horizon autonomous agent run of Sonnet 5.5 (max) across two repos:

Scores don't correlate with turns, time or cost — Run 3 burned the most turns, time and money while scoring lowest, highlighting high variance and unpredictable costs in long-horizon agentic tasks. A log-scale score-vs-turns view with model filters is available.

Related event: Bug Hunt Bench: Sonnet 5.5 Leads at 55.5 Points but at High Cost and Variance(5 posts)→

Original post →

More from coding & agent

coding & agent channel →