Artificial Analysis launches Optima to benchmark models on your own workloads
mrdbourke · x · 2026-08-19
Artificial Analysis launched Optima last week, a platform for benchmarking models on your own workloads and comparing performance, speed and cost efficiency, with a video walkthrough on building custom benchmarks. Daniel Bourke's take: "the best evals are your own evals" — test models on your actual tasks rather than trusting generic leaderboards.
Related event: Artificial Analysis launches Optima for custom model benchmarking(3 posts)→
More from Apps
- Benchling launches Science Foundries: agents and scientists running labs end-to-end — nlarusstone · 2026-10-16
- ChatGPT's Dot Reviewed: Your Chief of Staff Is Still Just a Codex Wrapper — infinitely_zero · 2026-10-16
- Perplexity API now available in Lovable apps for real-time cited web answers — AravSrinivas · 2026-10-16
- Nvidia NemoClaw makes TIME's Best Inventions of 2026 as an agent that can't break containment — NVIDIAAI · 2026-10-16
- Box AI Extract plus OpenAI Decisions API automates document routing — craigsdennis · 2026-10-16
- Full 49-minute walkthrough: editing Facebook ads with Opus 5.5 — alexgoughcooper · 2026-10-16