Meta’s Mosaic uses a fleet of specialists for user embeddings
_reachsumit · x · 2026-07-28
Meta introduces Mosaic, a user-modeling platform that replaces a single shared user encoder with a fleet of specialists.
- The system uses four architecturally different specialist families: memorization-driven, dense-heavy, sequential-based, and CoTrain models.
- Two new techniques, MRM and CRL, are designed to maximize the marginal contribution of each added specialist.
- Meta also proposes CoEval and User Tower Zero-Out, a logging-free embedding evaluation framework meant to speed development while staying aligned with downstream accuracy.
- The serving stack is hybrid CPU/GPU and supports both online and offline serving depending on freshness, latency, and compute needs.
The paper reports consistent offline NE gains and online improvements.
More from Research
- MIT's Neil Thompson: AI comes for tasks before jobs, and fixed costs favor big firms — bigdata · 2026-10-16
- UMD's PAIR framework bridges perception and action in VLA models via bridge tokens — Kaixi Feng · 2026-10-16
- CI-MSE offline metric hits -0.87 Spearman correlation with real robot task success vs weak raw MSE — chris_j_paxton · 2026-10-16
- Colossal Biosciences uses AI to decode genetic switches behind the extinct dodo — castrotech · 2026-10-16
- Colossal Biosciences uses AI to identify gene switches in dodo de-extinction push — castrotech · 2026-10-16
- Cheng Lou open-sources Handwired: hand-written weights turn code into training-free neural nets — dotey · 2026-10-16