Matt Shumer: The 'cheap' model often costs more once you count retries

mattshumer_ · x · 2026-11-21

Matt Shumer argues against the reflex of mandating cheaper models to save money: sticker price per token isn't the cost of a finished job. Smarter models take fewer steps and make fewer mistakes, so you buy far fewer tokens. He likens it to hiring a student at $20/hr for 100 hours versus Einstein at $1,000/hr for one. Concrete examples:

His advice: compute end-to-end task cost (total tokens plus human time) rather than comparing per-token rates — and send that math to your boss before they downgrade your model access.

Original post →

More from Venture

Venture channel →