NeMo Data Designer tech report: 25 trillion tokens generated via open-source synthetic data framework
code_star · x · 2026-09-18
The team behind NeMo Data Designer (grown out of Gretel, now under NVIDIA) released a tech report (arXiv:2609.17699) for their open-source multimodal synthetic data generation framework.
Key points:
- Declarative configuration: humans or agents define each dataset column — text, code, structured outputs, images, embeddings, and statistical samplers steering diversity — extensible via a plugin system.
- Configurations are inspectable artifacts supporting sharing and reproducibility; a preview-and-revision loop lets users validate small samples before full-scale generation.
- Runtime handles dependency resolution, scheduling calls to user model endpoints, and retries.
- Over 25 trillion tokens have run through the framework to date, with case studies spanning structured, agentic, multimodal, and domain-specialized datasets, including ones used in Nemotron model development.
- The author recounts the pre-acquisition grind at Gretel and notes the design choices turned out ideal for agentic dataset building in 2026.
Related event: NVIDIA Open-Sources NeMo Data Designer, 25 Trillion Tokens Generated(3 posts)→
More from coding & agent
- 12MB 挑战 6.5GB:开发者用 Claude 开源 Photoshop 平替 Compositor — dotey · 2026-09-19
- Univer open-source project tackles why AI agents still can't do office work — alifcoder · 2026-09-19
- 何时该放弃 LLM 训分类器:QuixiAI 开源 ReAligned-Classifier — QuixiAI · 2026-09-19
- Scale CEO touts Muse agent that hunts FB Marketplace deals for NYC moms — alexandr_wang · 2026-09-19
- Microsoft ships Playwright Workspaces remote MCP with 22 browser tools for agents — WirelessLife · 2026-09-19
- Ada.Url brings the Ada URL parser to .NET: 1.9x faster than System.Uri, WHATWG-compliant — lemire · 2026-09-19