The most useful fine-tuning data is real traces: sessions, agent runs, tool calls

ziv_ravid · x · 2026-11-20

Ziv Ravid's thread (posts 5-6): the most useful data is traces of real activity — user sessions, agent runs, tool calls. They don't need to be labeled, or labels can be sparse with no answer for each step. Keep a small dataset aside to verify you didn't break anything.

Earlier advice: start with a few hundred real production tasks, look at the data manually to build intuition about what good outcomes look like, then define metrics — that becomes much easier afterward.

Related event: Engineer's Deep Dive Maps Enterprise Post-Training from Motive to Evaluation(22 posts)→

Original post →

More from coding & agent

coding & agent channel →