Baidu’s Unlimited OCR uses R-SWA to parse long documents in one pass
vista8 · x · 2026-07-22
Baidu’s Unlimited OCR is getting strong attention after its release.
- The model uses a Reference Sliding Window Attention (R-SWA) mechanism instead of page-by-page OCR plus result stitching.
- It keeps KV cache size constant during decoding, inspired by how humans read and copy long documents.
- The model has 3B parameters, but inference reportedly activates only 500M parameters and can run locally.
- It can process long documents in one pass, preserving text, formulas, tables, and reading order across pages.
- Reported numbers from the post: 93% accuracy on a benchmark, <0.11 error rate even beyond 40 pages, 2.24M Hugging Face downloads, and 16.7k GitHub stars.
Related event: Baidu's Open-Source Unlimited OCR Draws Attention for Long Document Parsing(2 posts)→
More from Models
- Hugging Face reportedly used open-weight GLM 5.2 after proprietary models failed — rasbt · 2026-07-22
- Google Exec Seeks Feedback on Gemini 3.6 Flash & 3.5 Flash-Lite Performance — patloeber · 2026-07-22
- Gemini 3.6 Flash is 2x faster and 18% cheaper, but independent tests say it is not smarter — etherd0t · 2026-07-22
- Critic says OpenAI incident coverage confuses bad reward functions with autonomy — ambaonadventure · 2026-07-22
- Google Launches Gemini 3.5 Flash Cyber Model for Security Teams — pushmeet · 2026-07-22
- Rumor says GPT-5.6 Sol could hit 750 tok/s after Cerebras upgrades — haider1 · 2026-07-22