Half of PM job listings now ask for evals skills; Ramp, Shopify, Harvey, Cursor share gains
HamelHusain · x · 2026-09-23
Lenny Rachitsky notes evals keep coming up in his podcast and PM conversations: nearly half of the 25 PM job openings he shared last week ask for eval-writing experience. Companies keep quantifying the payoff — Ramp took automatic receipt collection from 35% to 83% accuracy; Shopify shipped an AI workflow builder 2.2x faster and 68% cheaper than its frontier-model setup; Harvey rebuilt its AI contract reviewer, nearly doubling internal quality; Cursor tuned Auto Balance routing for higher satisfaction at 41% lower cost.
More from coding & agent
- Sentry CEO Shows Off Richer UIs for Junior's Automation Agents — zeeg · 2026-09-23
- Forward Future puts Opus 5.5 through 8 tests: cities, games, animation — MatthewBerman · 2026-09-23
- Single 186KB HTML file creates Blender-quality 3D product page via AI — jnack · 2026-09-23
- Alibaba contributes $3M to Omarchy to build an ideal agentic OS — AIFlow_ML · 2026-09-23
- Jev Founder Publishes Coding Agent Harness Guide Claiming 200x Speed, 400x Cost Cut — _AustinCalvert_ · 2026-09-23
- AI trading agent backtest: 1,155 decisions in 77 days for $0.09, still trails buy-and-hold — nikola_mr64990 · 2026-09-23