Radical Numerics details data mixing for DNA+language pretraining of Omnii
aaron_lou · x · 2026-10-13
Radical Numerics shares how it scaled data mixing to thousands of sources across 20+ modalities for pretraining Omnii, its multimodal genome model trained jointly on DNA and natural language. The team frames improved data mixing as a key ingredient for large-scale pretraining and calls the biology-AI intersection the next frontier.
Related event: Radical Numerics Shares Omnii Multimodal Genomic Model Pretraining Recipe(2 posts)→
More from Research
- Hugging Face researcher admits the decision index now faces MTEB's leaderboard-gaming problem — antoine_chaffin · 2026-10-13
- RT-SAFE targets real-time safety blind spot in embodied AI — repligate · 2026-10-13
- Researchers release research blog post months in the making — logangraham · 2026-10-13
- NeurIPS position paper warns generative molecular dynamics evaluation is misleading the field — FrankNoeBerlin · 2026-10-13
- Live talk: MinerU-Popo paper on fixing OCR's cross-page context failures — HamelHusain · 2026-10-13
- OpenAI math repo's 'exact complex arithmetic' claim draws fire over arbitrary-precision assumption — jessi_cata · 2026-10-13