Search configuration impacts agent accuracy 40x more than model choice

RichardSocher · x · 2026-09-01

An independent evaluation by Braintrust on 1,329 current events questions found a counterintuitive result: search configuration impacts agent accuracy about 40x more than model choice. The study compared 4 models and 14 conditions, showing that web access significantly narrows the performance gap between models.

Original post →

More from coding & agent

coding & agent channel →