Handed a 300-Email Procurement Inbox, the Agent Must Decide What's True and Buy
alifcoder · x · 2026-08-26
The procurement test in CommerceAgentBench hands the agent an inbox of roughly 300 emails, buried with supplier quotes, revised quantities, delivery terms, payment details, withdrawn quotations, and similar-looking supplier identities. The task is not to "summarize these emails" but to figure out what is actually true, narrow down valid options, and support a final buying decision based on rules established by a human.
More from Research
- Schmidt Sciences awards $10M to 19 AI humanities research teams — OdedRechavi · 2026-10-15
- Mistral and CERN partner to build a Large Physics Model trained on billions of simulated collisions — MistralAI · 2026-10-15
- Global Transport coupling lifts guided flow generation: ImageNet FID 2.06 to 1.91 — mmbronstein · 2026-10-15
- Your breathing gives you away: Wi-Fi signals can reveal your breath rhythm — TinfoilTricorn · 2026-10-15
- Beyond text correlation: attaching a geometry simulator to ground model reasoning — gerardsans · 2026-10-15
- Sequen CEO Zoe Weil: Ranking Models Should Optimize Purchases, Not Clicks — TWIML AI Podcast · 2026-10-15