you.com search enters RL loop to train Nemotron, lifting BrowseComp to 45.45%

PolarBearby · x · 2026-10-07

you.com partnered with NVIDIA and CoreWeave to integrate web search into the reinforcement learning loop for the open-weight model Nemotron 3.5 Lightning, post-training it for web search.

Key results:

Under the hood, CoreWeave's RL Rollouts hot-load new weights into live deployments without touching in-flight requests — about 15x faster than a redeploy cycle — making inference-in-the-training-loop RL post-training practical. It's a full-stack demonstration of training open-weight models with external search tools via RL.

Original post →

More from Infra

Infra channel →