Study: General Coding Agents Beat Hand-Designed Data Agents by 37 Points With 4x Fewer Turns

CShorten30 · x · 2026-09-08

A new paper from lianapatel and colleagues tracks the evolution of data agent capabilities over the past two years and finds general-purpose coding agents beat hand-designed data agents by up to 37 points, using 4x fewer turns.

The authors frame it as "the bitter lesson is coming for data agents too": as better models rapidly eat the stack, the key question for system researchers is what problems remain worth solving to enable the next frontier of data agents. A full thread and paper link accompany the finding.

Related event: Study Finds General Coding Agents Beat Specialized Data Agents by Up to 37 Points(2 posts)→

Original post →

More from coding & agent

coding & agent channel →