RunWeave: open-source chaos harness injects rate limits, 503s and broken tool calls into agents

MrinmayDas · reddit · 2026-11-21

A developer released RunWeave, an open-source (Apache-2.0) agent test harness that runs locally with no API key, targeting the "easy to demo, hard to trust" problem.

Its chaos profile injects seeded, exactly reproducible failures: rate limits, 502s, timeouts, slow first tokens, dropped streams, malformed tool-call JSON, unknown tools, and context-length errors, then reports which runs failed and why.

In his weather-agent example, the openai client's built-in retries took the flaky profile with zero failures; he's curious how other stacks hold up and welcomes contributions.

Original post →

More from coding & agent

coding & agent channel →