Databricks Chief AI Scientist: Evals Are the Biggest Bottleneck to Enterprise AI Adoption
jefrankle · x · 2026-10-22
On The Frontier podcast, Databricks Chief AI Scientist and MosaicML co-founder Jonathan Frankle argued that only a very low percentage of enterprise tasks have been automated with AI — and that models are already smart enough to do far more.
The real bottleneck, he says, is knowing whether AI is doing what you want: enterprises need measurable specifications for qualitative tasks in their real data context — i.e., evals. Frankle discussed this with Mercor CEO Brendan Foody, framing eval engineering rather than model intelligence as the key blocker to enterprise adoption and AGI progress.
Related event: Eval, not intelligence, is AI's real bottleneck: Frankle(3 posts)→
More from coding & agent
- MiniMax M3.1 Flash pairs with SGLang Omni for interruptible real-time voice agents — MiniMax_AI · 2026-10-22
- Routing strongest model every turn is bad design: one route per turn, pin through tools — WirelessLife · 2026-10-22
- v0 adds Slack MCP support: read threads and post updates from your agent — iamsahaj_xyz · 2026-10-22
- Insurer portals blocked their data-center bots, so they moved automation into the user's browser — alex_verem · 2026-10-22
- Chrome DevTools adds Ads panel showing per-script CPU and network cost of ads — gaganghotra_ · 2026-10-22
- Shipping v5.0.0 with one prompt: Rork Max agent walks the whole app release — rudrank · 2026-10-22