FutureSim Q3: LLMs now genuinely improve from experience, Opus 5.5 tops at 50%

rickasaurus · x · 2026-11-16

The FutureSim benchmark (replaying real-world events to test forecasting past models' knowledge cutoff) released Q3 2026 results showing a discontinuous change: last-gen LLMs genuinely get better from experience.

Built by a team from ELLIS Tübingen/Max Planck Institute et al. (arXiv:2605.15188), the results suggest test-time adaptation is now improving industry-wide — a key signal for measuring long-horizon, open-ended agent adaptation.

Related event: Opus 5.5 Tops FutureSim Q3 Benchmark with 50+ Sub-Agents(2 posts)→

Original post →

More from Models

Models channel →