Track cost per finished task, not token price: the agent metric that matters

arpit_bhayani · x · 2026-11-16

Arpit Bhayani argues builders obsess over token pricing while ignoring how fast the agent loop converges. Every tool call resends conversation history; prompt caching lowers but doesn't eliminate cost. Failed attempts add turns with longer histories, so trimming context or downgrading models can backfire — you save cents per call but pay for extra correction turns. The metric to track is cost per finished task, including retries and wasted turns; reduce loop iterations via clearer instructions and more reliable tools.

Original post →

More from coding & agent

coding & agent channel →