35K Synthetic Examples for $16: Distilling Qwen3.8 on Hugging Face Jobs with datatrove
vanstriendaniel · x · 2026-08-18
Daniel van Strien of Hugging Face published the first guide on synthetic data generation with datatrove. Context: datatrove 0.10.0 adds a Jobs backend — pipelines run on HF Jobs with fan-out, multi-stage dependencies, retries and resume, no Slurm cluster needed — plus HF storage buckets as a DataFolder (hf://buckets/...) and preserved reasoning outputs from inference. Walkthrough: using Qwen/Qwen3.8-27B-FP8 as teacher, he generated tl;dr summaries over 36,000 model/dataset cards as training data for a small summarization model (card summaries are known to work better than raw cards as embedding input for search). The full 35,837-example dataset regenerated in one afternoon for $15.58, zero local GPU, with a calibration-first workflow and length-controllable outputs.
Related event: Hugging Face Generates 35K Model Card Summaries for Just $16(3 posts)→
More from coding & agent
- Dev: I'd never pick Anthropic via API, yet I keep coming back to Claude Code — bclavie · 2026-08-18
- Founders Refused Ad Account Access, So This Team Built Approval Gates Into Its Agent Core — swe666 · 2026-08-18
- Developer rolls back OpenAI's Agent Plugins standard: cross-client frontmatter breaks compatibility — kieranklaassen · 2026-08-18
- 4-dev side team makes $3k/month, wants Claude + MCP to run $3k/month ads — Elegant_Tourist_8313 · 2026-08-18
- Google One vs. Code Assist: small business owner puzzles over the 1,500 daily request cap — innovaldragon · 2026-08-18
- 2,500 RSVPs for 250 Seats: OpenAI Codex Meetup Seoul Sets Record — gabrielchua · 2026-08-18