Synthetic pretraining dataset FinePhrase tops 2.8M downloads on Hugging Face

yb2698 · x · 2026-11-17

Joel Niklaus announced that FinePhrase, a synthetic pretraining dataset, has surpassed 2.8 million downloads on Hugging Face.

Built from FineWeb-Edu, the dataset uses SmolLM2-1.7B-Instruct to rewrite documents into four formats—FAQs, math problems, tables, and tutorials—totaling 1 billion rows, generated with DataTrove and speculative decoding. All four configs are open for download.

Original post →

More from Research

Research channel →