Google's Retrieve-for-Train uses diffusion models to make complex AI search 20x faster

steveplunkett · x · 2026-09-16

Google Research introduced Retrieve-for-Train (RFT), a framework that replaces slow, redundant autoregressive query fan-out with a lightweight diffusion model, moving the reasoning to an offline training phase. The result: expert-level, multi-faceted search slates delivered in sub-second time, up to 20x faster at a fraction of the cost.

A "Vendi Score" guarantees diversity so results don't repeat the same ideas. The author notes it likely has implications for Search itself, but the paper is dated March 2026 and deployment status is unclear.

Related event: Google's Retrieve-for-Train Moves Search Thinking to Training Time for Sub-second Responses(6 posts)→

Original post →

More from Infra

Infra channel →