Surge AI Releases High-Quality Datasets: STEM Data Unexpectedly Boosts Coding by 6pp

echen · x · 2026-08-01

Surge AI's research team shared concrete performance gains on frontier models using their high-quality post-training datasets. Experiments show that training on just a fifth of their data yields significant improvements across various benchmarks:

Interestingly, cross-domain generalization was observed: training on non-coding (e.g., STEM) datasets still improved coding performance by 6pp on SWE-Bench Pro without containing a single line of code. The full datasets are now available off-the-shelf with a 'pay-if-it-moves-your-metric' model.

Related event: Surge AI Releases High-Quality Training Datasets, Boosting Model Performance with Less Data(5 posts)→

Original post →

More from Models

Models channel →