SREGym open-sources a benchmark replaying real incidents like Cloudflare and Reddit outages for SRE agents

tianyin_xu · x · 2026-11-19

SREGym is an open-source benchmarking platform (419 stars, MIT) that builds live, reproducible system environments for evaluating SRE agents. It already simulates well-known real-world cloud failures — each with a linked postmortem and simulation: Cloudflare WAF regex CPU exhaustion, admission webhook TLS mismatch, conntrack table exhaustion, GKE IP exhaustion, Kafka poison pill, and the Reddit Pi-Day outage. The thread grew out of a call for open, independently verifiable benchmarks, since internal evals tend to mirror a team's own blind spots.

Original post →

More from coding & agent

coding & agent channel →