Perplexity releases pplx-embed-v2-late: 18B ColBERT distilled into 9B and 0.6B retrievers

beirmug · x · 2026-10-08

Perplexity officially released pplx-embed-v2-late, two late-interaction embedding models that retrieve text, images, and page screenshots in a shared embedding space for cross-model querying. Per team member @bowangbo, they trained an 18B ColBERT teacher and distilled it into 9B and 0.6B versions (the 0.6B includes a vision tower). Sharing token embedding space enables 9B offline indexing with 0.6B online search. Both hit frontier performance and are on Hugging Face; a Dense variant is coming.

Related event: Perplexity Open-Sources Multimodal Embedding Models pplx-embed-v2-late(38 posts)→

Original post →

More from Models

Models channel →