Four open-source AI agents killed mid-action all repeat side effects on retry

merlinofthewater · reddit · 2026-10-09

The author crashed four published agent codebases (Cua, Skyvern, Corsair, Inconvo) at pinned commits mid-action and retried like a supervisor would: Cua double-charges on checkout, Skyvern strands tasks in 'running' forever, Corsair corrupts its rotating OAuth token, and Inconvo pays 60% more model calls per interrupted answer. Shared root cause: none records which actions already completed. A 25,930-episode arXiv study found agents self-report success in 90% of episodes where they duplicated an effect, so self-reported traces can't be trusted. Harnesses and raw ledgers are open-sourced, running against local fakes with no API key needed.

Related event: Four Open-Source Agents All Repeat Completed Actions After Interruption(2 posts)→

Original post →

More from coding & agent

coding & agent channel →