Together AI study: top reasoning effort costs up to 42x on tasks low effort already solves

james_y_zou · x · 2026-10-30

The Together Compute team published a systematic study on choosing the right reasoning effort level.

Setup: if your agent solved a task at xhigh effort, would low have solved it too? You can't tell without rerunning — and you pay for every token.

Method: they tested a matrix of models × reasoning effort levels × benchmarks to quantify the capability-cost tradeoff.

Key finding: on tasks that low effort can already solve, top effort costs up to 42x more.

Why it matters: it gives agent builders data for matching effort levels to task difficulty — defaulting to max effort wastes money on easy tasks, and dynamic effort selection is a major lever for cutting agent runtime costs.

Related event: Together AI study: top reasoning effort tier costs up to 42x more tokens(6 posts)→

Original post →

More from coding & agent

coding & agent channel →