Hugging Face releases FineDNA: 300B+ token dataset to teach LLMs DNA
LoubnaBenAllal1 · x · 2026-11-01
Loubna Ben Allal (Hugging Face) introduces FineDNA, billed as the best dataset to teach any language model DNA: 300B+ tokens mixing genomic sequences, papers, and web pages containing DNA alongside text, plus 200k SFT and 98k RL samples. Midtraining Qwen3-14B on it yields the strongest open DNA model (Carbon-X); follow-up posts cover the midtraining recipe, RL results, and final benchmarks.
More from Research
- Semantic bandit experiments show irrelevant wording skews LLM exploration-exploitation balance — burkov · 2026-11-01
- RoboColiseum robot benchmark: Claude Opus 5.5 scores 76.28, edging out GPT-6 Astra — jiqizhixin · 2026-11-01
- ETH Zurich releases EgoHTR: 150k-frame egocentric 4D dataset for humanoid terrain traversal — Scobleizer · 2026-11-01
- DiffusionART-Flash open-sourced: RL for diffusion models with 25x fewer training timesteps — YangYou1991 · 2026-11-01
- NVIDIA's World from Motion accepted to NeurIPS 2026: dynamic 3D from monocular video — Scobleizer · 2026-11-01
- HuggingFace releases FineDNA dataset, turning Qwen3-14B into a DNA model that beats GPT-6.1 — loubnabnl · 2026-11-01