RunWeave: open-source chaos harness injects rate limits, 503s and broken tool calls into agents
MrinmayDas · reddit · 2026-11-21
A developer released RunWeave, an open-source (Apache-2.0) agent test harness that runs locally with no API key, targeting the "easy to demo, hard to trust" problem.
Its chaos profile injects seeded, exactly reproducible failures: rate limits, 502s, timeouts, slow first tokens, dropped streams, malformed tool-call JSON, unknown tools, and context-length errors, then reports which runs failed and why.
In his weather-agent example, the openai client's built-in retries took the flaky profile with zero failures; he's curious how other stacks hold up and welcomes contributions.
More from coding & agent
- AI gateways are becoming the key control layer in production AI stacks: 8 capabilities — goyalshaliniuk · 2026-11-21
- Mnemos 2.0: agent memory designed to preserve what matters for the next session — RileyRalmuto · 2026-11-21
- InferenceBench ranks agents on LLM serving speedup: Claude Opus 5.5 tops at 12.08x, agents lose to simple hyperparameter search — maksym_andr · 2026-11-21
- 4 architecture patterns to tame multi-agent system reliability, from a 27-year reliability engineer — bibryam · 2026-11-21
- AutoCut + FrameAtlas: open-source local-first video editing driven by Claude Code via MCP — moheshmohan · 2026-11-21
- InfoQ: What an agent harness is, and two ways to build one — bibryam · 2026-11-21