Different coding agents can produce very different estimates from the same model spec

JessicaHullman · x · 2026-07-28

Different coding agents can receive the exact same model specification and still produce very different estimates.

The post argues this is unsurprising in statistical modeling workflows: the differences are coming from how the agents handle the details, not from some mysterious failure of the underlying model alone. In other words, the “devil is in the details” when agents are used for analytical work.

Original post →

More from coding & agent

coding & agent channel →