Make Your Evals Better: More Edge Cases and Real User Inputs, Not Synthetic Slop
cephaloform · x · 2026-09-19
Darren Angle urges developers to improve their evals by adding more edge cases, weirder inputs, and real experiences users actually have — and to skip synthetic data entirely. His core point: "get the real deal under eval and you can have it all." A short but practical reminder on eval engineering for agents and models.
More from coding & agent
- SAM demo: secure cross-device agent mesh in 30 seconds, phone sensors become MCP tools — rakyll · 2026-09-19
- 'I asked for 3 lines, got 400 lines and 17 tests': dev's complaint about AI coding agents goes viral — burny_tech · 2026-09-19
- Pace Layers explain AI anxiety: when slow layers are forced to sprint — dbreunig · 2026-09-19
- AWS treats DRAM as the scarce resource in agent infra with new AgentCore runtime — bookwormengr · 2026-09-19
- pdfcn: open-source React PDF components built on Takumi and Forme — tom_doerr · 2026-09-19
- Elvis Saravia on integrating Jev into agent harnesses: cheaper workflows, verifiers and new UX — omarsar0 · 2026-09-19