Artificial Analysis launches Optima to benchmark models on your own workloads
mrdbourke · x · 2026-08-19
Artificial Analysis launched Optima last week, a platform for benchmarking models on your own workloads and comparing performance, speed and cost efficiency, with a video walkthrough on building custom benchmarks. Daniel Bourke's take: "the best evals are your own evals" — test models on your actual tasks rather than trusting generic leaderboards.
Related event: Artificial Analysis Launches Optima for Custom Model Benchmarking(2 posts)→
More from Apps
- Friend with zero coding experience one-shots and ships a website with Lovable — alexmacgregor__ · 2026-08-19
- Slack AI impresses author by summarizing talk better than they could — moyix · 2026-08-19
- Shares ChatGPT prompts that secured 5 job interviews in a week — Aiden_Tech_Ai · 2026-08-19
- Using Computer Use to escape awkward social situations — nickbaumann_ · 2026-08-19
- Turn an average resume into an interview-winning CV in 5 minutes with Claude — Aiden_Tech_Ai · 2026-08-19
- Comparing Gemini Location App vs. Side Button — ldierk · 2026-08-19