Accio Open-Sources CommerceAgentBench with 107 Tasks; Top Score Sits at 61.7%
testingcatalog · x · 2026-08-29
Accio has open-sourced CommerceAgentBench, a 107-task benchmark spanning procurement, product listing, operations, order fulfillment, and after-sales. The benchmark ranks scores based on the changes an agent leaves behind in a mock commerce stack, such as labels applied, drafts saved, listings published, and shipment IDs returned. The company tested thirteen different model families, with the ceiling currently sitting at 61.7%.
Related event: Alibaba's Accio Open-Sources CommerceAgentBench; Top Score Just 61.7%(6 posts)→
More from coding & agent
- A versioned bootstrap loader pattern for keeping AI-generated code always shippable — NickPassig · 2026-10-15
- Amazon blocks AI shopping agents; Maritime offers $1/month Android MCP workaround — Scobleizer · 2026-10-15
- Dev vibe-codes open-source newsletter platform, 83% cheaper than Beehiiv from $19/mo — marclou · 2026-10-15
- ERP AI launches Proto: 'headless SaaS' business software built for AI agents — Aiden_Tech_Ai · 2026-10-15
- Engineering managers need deep reading, not just agent summaries: 5 recommended resources — rseroter · 2026-10-15
- Adding motion graphics with just a prompt: the Claude Motion x ElevenLabs MCP workflow — CurieuxExplorer · 2026-10-15