Boo Bench: 179 real pages that trap doc parsers in repetition loops
llama_index · x · 2026-10-30
LlamaIndex shares more detail on Boo Bench: all test pages come from real documents — dot leaders, tables full of 0.00, near-identical rows, scans in rare scripts.
A parser gets a "Boo" if it repeats past what's on the page (one model turned 246 redaction x's into 23,004), returns nothing, or is still running at the 10-minute timeout.
More from Research
- Dev ditches unanimous-vote stopping rule for a judge in multi-AI debate project — lluisantoni · 2026-10-30
- Google's AI Search Uses Your Knowledge Graph Facts Without Linking, RESONEO Research Finds — dejanseo · 2026-10-30
- Raon-1-mini-preview runs natively on hipfire but 200x slower prefill than llama.cpp, patch released — Queasy_Asparagus69 · 2026-10-30
- TEM: Transformer Energy-based Models scale beyond diffusion without guidance — du_yilun · 2026-10-30
- NVIDIA's AgentBaton cuts agent API costs 65.9% with a single model handoff — dair_ai · 2026-10-30
- Stanford releases RT-J, a System 1 model predicting structured data in one forward pass — jure · 2026-10-30