The wrong question about LLMs in pipelines: which stages get determinism guarantees

aronchick · x · 2026-09-26

aronchick opens a thread on LLMs in data pipelines: the question is almost never "should I use LLMs?" but which stages get determinism guarantees and which don't. The thread argues per-stage assignment: joins/aggregations/dedupe/validation stay deterministic, messy extraction and classification go to models, and the only production-surviving shape is LLM stage → validation gate → deterministic post-processing.

Related event: aronchick: In LLM data pipelines, draw the determinism boundary first(7 posts)→

Original post →

More from coding & agent

coding & agent channel →