Microsoft Research: discarding singleton proteins in PLM training is likely wrong
KevinKaichuang · x · 2026-08-18
A Microsoft Research / Brown preprint argues the common practice of discarding metagenomic "singletons" in PLM pretraining is probably wrong. Singletons make up 43% of the 3.34B-sequence GigaRef atlas; many show high homology and higher Pfam domain density per length, representing the long tail of functional diversity most valuable for model training.
More from Research
- 3rd 3D HUMANS Workshop Returns at ECCV 2026 — dimadamen · 2026-08-18
- TogetherAI open-sources XoRL: 0 train-infer mismatch for large MoE RL training — PandaAshwinee · 2026-08-18
- SegDAC: Boosting Visual RL Generalization with Dynamic Object Tokens — GlenBerseth · 2026-08-18
- Study Compacts Context, Finds Prompt Caching Makes Summarization Obsolete — AI Engineer · 2026-08-18
- Georgia Tech's 2026 LLM Course: From MoE and Self-Play RL to Diffusion LMs — cocoweixu · 2026-08-18
- New Dataset: 35k Hugging Face Model Summaries Generated for $0.43 per 1k Rows — vanstriendaniel · 2026-08-18