Datology AI ships Zephon, a deterministic data loader that fixes eval drift across GPU counts

josh_wills · x · 2026-10-07

Datology AI introduces Zephon, a data loader built to process training data on the fly and deterministically. Running thousands of data experiments, the team kept hitting two pain points: the same run on 16 vs 8 GPUs produced different evals, and every pipeline change forced re-materializing the entire dataset. Zephon's on-the-fly, deterministic processing eliminates eval drift and redundant materialization.

Related event: Datology AI Open-Sources Zephon, an Elastic Deterministic Dataloader(3 posts)→

Original post →

More from Infra

Infra channel →