What Labs Actually Do With $100M Data Deals: Turning Company Workflows Into Agent Eval Sandboxes
StewartalsopIII · x · 2026-11-16
Everyone talks about labs spending hundreds of millions on data, but almost no one looks at what happens after the deal closes.
The core observation: researchers take company workflows and turn them into small sandboxes. Every tool call and edge case gets converted into an environment where agents can run thousands of trajectories until they stop breaking things.
The real value isn't the raw data — it's the decision logic hidden in the workflow, plus the built-in eval with outcome labels that comes with it.
More from AGI Musings
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16
- A diagram for judging quality in cultural artefacts: coded meaning and exemplary moves — round · 2026-11-16
- Economists argue humans will be fine without work: jobs were just reputation and friendship engines — paulnovosad · 2026-11-16
- Founder says he wakes every 90 minutes to unblock AI agents overnight — mobileraj · 2026-11-16
- Reading matters more in the AI era: non-native English writers are most vulnerable to AI-style drift — StewartalsopIII · 2026-11-16
- X debate: belittling technical achievements won't stop progress, argues paleologo — IgorCarron · 2026-11-16