Together AI boosted agent task success from 67% to 96% with homegrown agent evals

nutlope · x · 2026-11-17

Together AI's CEO details how they made their platform easier for coding agents, raising task success from 67% to 96% by building their own agent evals. They benchmarked baseline vs MCP vs Skills across 12+ tasks (two runs each, incomplete runs count as failures): Skills hit 97.2% pass rate, cut incomplete rate from 9.7% to 2.8%, and reduced avg end-to-end time from 11.6 to 9.3 minutes at $0.433/run. Full methodology included for building your own agent evals.

Related event: Together AI Shares Agent Evaluation Method, Boosting Task Success from 67% to 96%(3 posts)→

Original post →

More from coding & agent

coding & agent channel →