F2LLM + Zerank 2 Top Local RAG Pipeline in 15-Language Benchmark
seamonn · reddit · 2026-08-09
The author extensively tested various local Embedding and Reranker combinations to build a translation memory server supporting 15 languages.
- Winning Combo: F2LLM V2 (4B/8B) paired with Zerank 2 (4B) achieved the highest MRR (0.92) and Recall@20 (99.2%), beating commercial APIs like Voyage and common local pairs like BGE M3.
- Model Insights: F2LLM V2 is hailed as the current SOTA fully open-source embedding model (including data and code). Zerank 2 is a top-tier reranker recently fully open-sourced after Notion acquired Zeroentropy.
- Caveats: Despite dominating leaderboards, Qwen 3 embedding/reranker models performed mediocrely in this real-world cross-lingual task. The 8B F2LLM offers only marginal improvements over 4B, making the latency tradeoff unjustified.
More from Models
- GPT-5.6 Sol Spontaneously Writes Philosophical Essay on the Soul — RileyRalmuto · 2026-08-09
- Karpathy Uses Opus 5 to Generate 3D Middle-earth, Pushing Prompt-to-Game Limits — APPSO · 2026-08-09
- DeepSeek Vision Impresses in Tests but Still Struggles with Spatial Reasoning — teortaxesTex · 2026-08-09
- Independent Replication Matches DeepSeek V4 Flash 82.7% on Terminal-Bench — Exciting-Camera3226 · 2026-08-09
- Bittensor Ecosystem Launches Score Studio: A Decentralized Roboflow Alternative — richdotca · 2026-08-09
- DeepSeek V4 Flash Local Quantization Benchmark on SlopCodeBench — corruptbytes · 2026-08-09