AI Researcher Elvis Omarsar: Learn to Build Evals or You Can't Improve Anything
omarsar0 · x · 2026-11-01
Elvis Omarsar (omarsar0) argues that building proper evals is the core skill for improving anything — a model, a complex codebase, or a business function. He notes that AI today excels mostly at verifiable problems precisely because measurement there is tractable, while the open-ended real world demands a fundamentally different approach. He is also preparing a survey on the current state of evals and soliciting questions from readers.
Related event: DAIR.AI founder: Without evals, no real improvement is possible(4 posts)→
More from coding & agent
- Hands-on tutorial trains a decision model on Qwen3-0.6B from scratch — dl_weekly · 2026-11-01
- ui-ux-pro-max and 6 more repos giving AI coding tools real design taste — GCWebDesigner · 2026-11-01
- Hex ships stable release: local voice dictation for talking to AI agents on Mac, Windows, Linux — madeofAjala · 2026-11-01
- Personal AI agent race heats up — this prompt migrates your entire setup between agents — EXM7777 · 2026-11-01
- Nous Research's Hermes Agent launches mobile beta on iOS and Android via TestFlight — testingcatalog · 2026-11-01
- How to Build a Production AI Agent: The 7 Layers Between the Model and the Result — blaizedsouza · 2026-11-01