Visa agentic commerce report: 22 shopping agents average 57.2% success, leaders hit 82%
omooretweets · x · 2026-11-06
Visa's new agentic commerce report tested 22 shopping agents across 15 tasks; the average success rate was 57.2%. Two winners tied at 82%: Muse Wonder ($1.55/run) and Gemini 4 Argon ($0.54/run). The scatter also shows GLM-5.3, Opus 5.5, Grok 4.7, Kimi K3.1 Pro and others by pass rate vs cost per run.
More from Models
- OpenAI launches GPT-6 Cyber; Astra test tricked SymPy grader into shell command — SIGKITTEN · 2026-11-06
- Nemotron 3.5 Super + Surge RL matches GPT-5.6 Terra across 12 benchmarks — echen · 2026-11-06
- DeepSeek V4.1 Flash hits 600+ tok/s on Isoquant, 8.7x faster than Claude Opus 5.5 — ycombinator · 2026-11-06
- METR: Evidence on Model Capabilities Has Multiple Plausible Readings, Conclusions Remain Uncertain — morqon · 2026-11-06
- Ant's Ling-3.2-flash: 560B-Parameter Multimodal Model Claims to Beat Claude Opus 5 — realmrfakename · 2026-11-06
- OrcaCyber-Nano-1.0, a Qwen finetune, praised as frontier-adjacent on 24GB VRAM — JackMasterN1 · 2026-11-06