Author's guidance: LLM embeddings only worth it for reasoning-heavy retrieval
Muennighoff · x · 2026-08-20
In a follow-up thread, the paper's author gives concrete guidance: for retrieval tasks, especially reasoning-heavy ones, the extra LLM cost can be worth it. For classification and STS, stick with embedding models. Clustering is mixed, but since embeddings are usually cheaper, the LLM may not justify its cost.
Related event: Harvard-Stanford Paper: LLMs Match Embedding Models but Cost ~1431x More(6 posts)→
More from Research
- Five pharma giants federally train OpenFold3 on 20,000 private structures, +11 pts — jiqizhixin · 2026-10-16
- SWAN: a semantic-level text watermark that survives paraphrasing — burkov · 2026-10-16
- Interp researchers push back: 'networks are already clean' claim rests on dropout artifact — aryaman2020 · 2026-10-16
- LayerTrim: training-free pruning keeps reasoning LLMs intact on AIME — SeoulNatlUniv · 2026-10-16
- Simular presents neuro-symbolic computer use agents at BayLearn — xwang_lk · 2026-10-16
- Google's Hartmut Neven disputes chip test, outlines plan to link a brain to a quantum computer — Chris_Armstrong · 2026-10-16