Baseten's Guide: Evaluate Open Models for Coding Agents on Your Own PRs
baseten · x · 2026-11-16
Baseten published a step-by-step guide for engineering leaders on cutting coding-agent costs with open models: set a quality bar against your trusted closed model, shortlist open alternatives, benchmark on 30 of your own merged PRs, track cache-adjusted cost per successful task, and pilot without changing your existing harness.
More from coding & agent
- Google Research open-sources PaperOrchestra, a multi-agent framework for writing AI papers — google-research · 2026-11-16
- ffmpeg-skill gives coding agents local video editing via 42 FFmpeg tools and MCP — kajisho5 · 2026-11-16
- Agents Now Reply to Slack Messages on Their Own, Resolving a Prod Incident Ghost-to-Ghost — iamrobotbear · 2026-11-16
- Engineer's Interview Prep Method: Use Claude to Find Which Answers Undersell Your AI Work — brandon_galang · 2026-11-16
- DeepSeek open-sources its app frontend "chat-demo", already at 3.9k stars — NielsRogge · 2026-11-16
- lemire: AI's real impact on coding is expanding the engineer's 'cognitive radius', not speed — lemire · 2026-11-16