Jerry Liu: define an eval and hillclimb—"eval driven development" solves most tasks

hwchase17 · x · 2026-10-09

LlamaIndex founder Jerry Liu argues that almost any task can be solved by defining an eval and hillclimbing over it, rather than hand-crafting deterministic or agentic workflows. Data providers' job is defining evals for all economic activity; yours becomes pointing frontier intelligence at the right problem and defining what good looks like. Agent application interfaces will evolve accordingly—complex processes still need explicit workflow builders, but most tasks compress into goals plus eval instructions. LangChain's Harrison Chase dubbed it "eval driven development."

Original post →

More from coding & agent

coding & agent channel →