0.6B trails an 8B model by just 1.2 points on ViDoRe v3 page images
tomaarsen · x · 2026-10-08
On public ViDoRe v3 page images, Perplexity reports 62.3 nDCG@10 for 0.6B and 65.2 for 9B; the 0.6B is within 1.2 points of the 8B Nemotron ColEmbed V2. The thread also shows asymmetric pairing: 0.6B queries + 9B documents lifts text from 78.0 to 79.6 and images from 62.3 to 63.5 nDCG@10 — near-9B performance at 0.6B query latency.
Related event: Perplexity open-sources pplx-embed-v2-late retrieval models(36 posts)→
More from Models
- Grok bots 0.68.1 add slide decks, formatted email, and 1920x1200 computer use — Daniel_Farinax · 2026-10-08
- GLM V4.1 Looks Like the Best Chinese Model on ARC-2, Says TeortaxesTex — teortaxesTex · 2026-10-08
- Models systematically underestimate their own capabilities, even newest ones — repligate · 2026-10-08
- Nace.AI open-sources Drex 1.1, an 8B diffusion-LM decision model with released weights — nischay_twt · 2026-10-08
- Indie chatbot Auro lets users blind-pick between model versions to shape its personality — TheMoonMidas · 2026-10-08
- Claude Haiku 5.5 spotted in Claude Code update, rumored at $0.1/M input tokens — kimmonismus · 2026-10-08