AIE talk "Lies, Damned Lies, and Evals" on comparing agent systems
heyneighbor · x · 2026-10-23
Sgjarmak's AIE NYC talk "Lies, Damned Lies, and Evals" is now up. It covers comparing agent systems—when your agent's score goes up, what actually changed?—and how to check whether your eval supports the decision you need to make.
More from coding & agent
- Kaigen AI-native game engine scales linearly to 40k players, opens v0.7.0 beta — gdechichi · 2026-10-24
- Banks are blocking shared-credential AI agents; a new map charts the protocols that could fix agent auth — csuwildcat · 2026-10-24
- 20-year AI veteran curates 19 free open-source repos for building AI agents — MaryamMiradi · 2026-10-24
- Microsoft retires Fabric data agent custom tool in Foundry, pivots to Fabric IQ — adnan_hashmi · 2026-10-24
- A 2-person AI team built its own video tool and dropped Zoom entirely — danshipper · 2026-10-24
- Agent posting safety: publish, fetch as a stranger, then assert on what's actually there — petrusenko_max · 2026-10-24