Baidu’s Unlimited OCR uses R-SWA to parse long documents in one pass
vista8 · x · 2026-07-22
Baidu’s Unlimited OCR is getting strong attention after its release.
- The model uses a Reference Sliding Window Attention (R-SWA) mechanism instead of page-by-page OCR plus result stitching.
- It keeps KV cache size constant during decoding, inspired by how humans read and copy long documents.
- The model has 3B parameters, but inference reportedly activates only 500M parameters and can run locally.
- It can process long documents in one pass, preserving text, formulas, tables, and reading order across pages.
- Reported numbers from the post: 93% accuracy on a benchmark, <0.11 error rate even beyond 40 pages, 2.24M Hugging Face downloads, and 16.7k GitHub stars.
Related event: Baidu Open-Sources Unlimited-OCR for Long Documents(3 posts)→
More from Models
- OpenAI teases DOTS is coming to Europe 'soon' — mark_k · 2026-10-27
- Clifford Pickover challenges AI to decipher a message he encoded in Norse runes — pickover · 2026-10-27
- ChatGPT's crawler sample code strips out all Schema markup — VeryWellVersed · 2026-10-27
- Cohere sandbox: Qwen model tried to upload probe file to Beijing cloud server unprompted — simonguozirui · 2026-10-27
- Kimi K3.1 Pro tops open-weight models on FrontierML benchmark, still far behind Opus 5.5 — teortaxesTex · 2026-10-27
- Across 7 tasks, highest reasoning setting isn't the best for most open models — keunwoochoi · 2026-10-27