Alibaba's SPAR sales agent lifts conversion 15.8% in A/B test across 200k+ merchants

ycombinator · x · 2026-11-04

Alibaba deployed SPAR, a sales agent on its 1688 B2B marketplace, and a live A/B test across 200,000+ merchants showed a 15.8% conversion lift — without touching model weights.

Key mechanics: SPAR treats each selling strategy as a hypothesis, starting at a 50/50 prior that converges to its true success rate as results come in, so lucky wins don't skew it. When a merchant churns for external reasons (e.g., budget cuts), an LLM marks it as such so it doesn't count against the pitch.

Ablations vs. direct prompting: no outer loop +12.6%, no inner loop +10.1%, no evolution +9.6% (matching Reflexion), while ExpeL's free-text lessons managed only +1.1%.

The poster notes their own product Scout (giga.ai) follows a similar approach: define a KPI, learn from every conversation, and keep testing improvements.

Original post →

More from coding & agent

coding & agent channel →