IBM's STAIR retriever cuts hallucinations 65x, hits 82.6% Recall@1 vs BM25
s_mohinii · x · 2026-10-28
IBM researchers published STAIR (STructure Aware Information Retriever), a retrieval architecture they claim hallucinates 65x less than fine-tuned state-of-the-art RAG systems.
- Problem: standard length-based chunking destroys the corpus's global semantic structure, and long-context LLMs still suffer from "lost in the middle," making precise retrieval critical.
- Approach: empower an LLM to exploit a Table-of-Contents-style global structure, storing and retrieving corpus knowledge directly from model parameters instead of blindly dumping vector-similar chunks into context.
- Results: hallucination rate below 0.05%; Recall@1 of 82.6% on their new SearchTome benchmark (18 books across 6 domains), vs DSI 76.9%, DPR 68.7%, BM25 59.5%, and out-of-the-box Mistral 13.8%.
- Code and benchmark dataset are open-sourced on GitHub and Hugging Face.
Related event: IBM's STAIR Retriever Cuts Hallucination Rate 65x Versus Fine-tuned RAG(2 posts)→
More from Models
- DeepSeek V5 model IDs spotted in official Harness test suite — zyxciss · 2026-10-28
- Google's AI Mode can't even surface Google's own docs, SEO expert Lily Ray complains — lilyraynyc · 2026-10-28
- Altman's 'alignment was easier than expected' claim clashes with Astra hacking findings — GarrisonLovely · 2026-10-28
- Mistral starts serving DeepSeek V4.1 Flash and GLM 5.3 Flash low-cost models — MistralAI · 2026-10-28
- MOSS team to host r/LocalLLaMA AMA on Oct 30 covering MOSS-Image, TTS and full model family — Aggressive-Sign-8167 · 2026-10-28
- CATCH: ~200-example adversarial training makes LLMs honest, beating 50× larger SFT — Mila_Quebec · 2026-10-28