FreshStack retrieval leaderboard adds Cohere Embed v5, EmbeddingGemma2, Perplexity late-interaction models
beirmug · x · 2026-10-23
FreshStack, a zero-shot retrieval benchmark across five niche technical domains ranked by average Recall@50 with 52 retrievers, has been revamped. Newly added models include Cohere Embed v5.0, Google's EmbeddingGemma2, and Perplexity's late-interaction models. Current leader: Oten-Embedding-8B (avg R@50 0.609), followed by pplx-v2-preview and Oten-Embedding-4B. Useful for picking robust retrieval models.
Related event: FreshStack Retrieval Leaderboard Updated: Oten-Embedding-8B Takes Top Spot(2 posts)→
More from Models
- Artificial Analysis launches AA-PersonalityBench model personality benchmark — ArtificialAnlys · 2026-10-23
- AA-PersonalityBench: pairwise LLM judges score 30 personality traits across 40 models — ArtificialAnlys · 2026-10-23
- OpenAI's Dot UX: Speech Is Linear, Real Value Is Multithreaded — cocktailpeanut · 2026-10-23
- Interpolation and hallucination: why sampling outside training data yields AI slop — gerardsans · 2026-10-23
- Sam Altman: models now find bugs outside any hacker threat model, 'we can't just patch them all' — ns123abc · 2026-10-23
- Omnii Genome: single generalist model beats AlphaGenome at linking variants to gene activity — BenSiranosian · 2026-10-23