Look Beyond Per-Token Pricing

matei_zaharia · x · 2026-07-09

Databricks points out that looking solely at per-token pricing can be misleading. For example, while Sonnet 5 is cheaper per token than Opus 4.8, it consumes more tokens for a task, ultimately leading to higher total costs and lower quality.

This indicates that when evaluating coding agents, one should focus on the total cost per task and the final output rather than just the model's sticker price.

Related event: Databricks' Internal Coding Benchmark: Harness Design Matters More Than Model Price(16 posts)→

Original post →

More from coding & agent

coding & agent channel →