StockBench sim: open-source models sweep top spots, GPT-5 loses to buy-and-hold
PtrPomorski · x · 2026-10-22
A chart from the StockBench paper (arXiv 2510.02209) ranks LLMs on simulated trading of 20 Dow stocks (March–July 2025, one decision/day): Qwen3-235B-Think leads at +2.5%, with GLM-4.5 (+2.3%) and Claude-4-Sonnet (+2.2%) close behind. Buy-and-hold returned +0.4%, beating GPT-5 (+0.3%), while GPT-OSS-20B lost -2.8%. Open-source models swept the top spots in this single-window simulation.
More from Models
- Claude didn't invent scorpion antivenom: The Verge debunks viral AI drug claim — The Verge AI · 2026-10-22
- Cohere's CulturalRiddles: 28 LLMs score 79.3% on cross-cultural riddles, but just 22% in some cultures — Cohere_Labs · 2026-10-22
- Rumors: Next Chinese AI Models Coming in Under 7 Days, Hacks 'Just the Prelude' — kimmonismus · 2026-10-22
- How much is an Anthropic Team subscription actually worth in tokens? Reddit tries to do the math — Acrobatic_Pool_713 · 2026-10-22
- Tencent open-sources Hunyuan-MT2: a 440MB offline translation model running on phones in 33 languages — alexcovo_eth · 2026-10-22
- Open tool computes API vs. RunPod self-hosting breakeven across 450+ models, with VRAM sizing — zackku · 2026-10-22