Devin Oncall tops SREGym with 100% end-to-end success, auto-resolving production incidents
tianyin_xu · x · 2026-10-16
Cognition launched Devin Oncall, which automatically investigates alerts and bugs to diagnose and resolve production incidents, already handling thousands of alerts daily for major companies.
- On SREGym 1.1 (UIUC's real-world SRE agent benchmark), Devin Oncall powered by Claude Opus 5.5 (high) took #1 on the curated 17-fault cohort: 100% diagnosis, mitigation, and end-to-end success, with 76s time-to-diagnose and 141s time-to-mitigate at 1.24M tokens per run.
- CloudThinker with GPT-6 Astra swept ranks 2-4, also hitting 100% end-to-end but several times slower.
- SREGym 1.1 is live with metastable failures, misconfigurations, and live system environments; 2.0 is on the way.
Related event: Cognition Launches Devin OnCall for Automated Production Incident Response(2 posts)→
More from coding & agent
- Handwired compiles plain JavaScript into an exact, fully differentiable neural net — ctjlewis · 2026-10-16
- Temporal Serverless Workers on Cloud Run: queue-driven autoscaling, scale to zero — rseroter · 2026-10-16
- Meta's Superintelligence Lab Runs 200+ Direct Reports—A Lesson for Flat Multi-Agent Systems — peterjliu · 2026-10-16
- LangChain CEO: the most interesting agent harness work lives at the harness-infra boundary — hwchase17 · 2026-10-16
- GitSwarm paper: agents share branchable Git memory, solving all 30 IMOProofBench problems in one run — anirudhg9119 · 2026-10-16
- Hands-on with Gemini 4 Argon: faster than Opus 5.5 but hallucinates more and costs more — prasenx · 2026-10-16