Baidu’s Unlimited OCR uses R-SWA to parse dozens of pages with a 3B model
vista8 · x · 2026-07-22
A Chinese post highlights Baidu’s open-source Unlimited OCR project and says Yann LeCun has noticed it.
The project proposes Reference Sliding Window Attention (R-SWA) instead of the usual page-by-page parse-and-stitch pipeline. The idea is to keep KV cache at a constant size during decoding by borrowing how humans read and copy long documents, allowing a 3B-parameter model to continuously parse dozens of pages in one pass.
The post also claims the project quickly became a major hit after open-sourcing:
- GitHub Trending and Hugging Face download charts went to No. 1 on launch day
- GitHub stars have passed 16.5K
- Hugging Face downloads are over 2.24M
- it has returned to the trending charts and is now ranked second
It is framed as infrastructure for large-model training-data cleaning.
Related event: Baidu Open-Sources Unlimited-OCR for Long Documents(3 posts)→
More from Models
- KOL defends B-tier rating for GPT-6.1 Sol, blames OpenAI's botched release naming — Angaisb_ · 2026-10-27
- php2shell exploit benchmark: only 2 of 5 frontier models can port the bug — xeophon · 2026-10-27
- Qwen Code v0.26.2-preview.0 adds session permission rules and experimental shared agent loop — qwen-code-review-bot · 2026-10-27
- GPT-6.1 Terra cuts factual error rate from 22.3% to 4.3%, an ~81% drop — haider1 · 2026-10-27
- GPT-6.1 Terra lands: early users praise speed, value and subagent performance — BenBajarin · 2026-10-27
- Leaked GPT-6.1 Terra benchmarks: cheap but 'boring', still far behind Astra and Claude — Angaisb_ · 2026-10-27