New Benchmark for Enterprise Ops Agents Released
xhluca · x · 2026-07-10
Artificial Analysis released EnterpriseOps-Gym-AA to evaluate whether frontier models can complete multi-step, state-dependent tasks in real enterprise operations scenarios while adhering to business rules and policies.
Based on ServiceNow's EnterpriseOps-Gym, the benchmark integrates the Stirrup agent harness across 8 business domains. It scores based on the final state of the underlying database rather than just the execution process. The post notes that Claude Fable 5 (max) currently leads the board.
More from coding & agent
- Security tip: use AI agents to build a NIST CSF knowledge base for incident response — prasanna_says · 2026-10-26
- Google Cloud Adds Self-Learning Context Enrichment to Knowledge Catalog for AI Agents — rseroter · 2026-10-26
- Cloudflare Previews Spend Limits for Workers and Durable Objects, Early Access Open — ritakozlov · 2026-10-26
- Shopify design lead on AI-era workflow: designers are becoming full-stack editors — KlausCodes · 2026-10-26
- Nace AI launches Drex for Search, cutting agent steps 62% and tokens 56% — testingcatalog · 2026-10-26
- Ultrametric open-sources Open Startup Repo to let AI agents run startup operations — garrytan · 2026-10-26