OvisOCR2: End-to-End Document Parsing Model
Shiyin Lu · hf · 2026-07-16
This is a technical report for 0.8B document parsing model OvisOCR2, designed to convert single-page document images directly into Markdown arranged in natural reading order, covering text, formulas, tables, and visual regions.
The authors built a data engine featuring:
- Filtered real-world document annotations
- Synthetic pages rendered from the same HTML source to ensure consistency between the image and the Markdown target
The training pipeline includes:
- supervised fine-tuning
- Reinforcement learning on a 4B branch with a multi-component reward design
- on-policy distillation back to the 0.8B model
- model fusion
As a result, OvisOCR2 achieved an overall score of 96.58 on OmniDocBench v1.6, securing the top spot at the time, and also scored the highest Avg3 of 75.06 on PureDocBench. Evaluations on custom long-tail and difficult scenario benchmarks also show leading results, indicating strong generalization and robustness beyond public leaderboards.
Related event: OvisOCR2 Tops Document Parsing Leaderboard(2 posts)→
More from Multimodal
- H3 long-form video experiment: 7-hour render, int8, peaked at 192GB RAM — SIR_NVAX_A_LOT · 2026-09-11
- 3D ResNet Paper Crosses 3,000 Citations Eight Years After CVPR 2018 — HirokatuKataoka · 2026-09-11
- Non-coder builds full-featured Android ComfyUI client with ChatGPT, submits to Google Play — ComfierUI · 2026-09-11
- RunningHub open-sources H3Lightning, speeding up MiniMax H3 video generation 12x — 智东西 · 2026-09-11
- FastH3-Live hits 22fps: acceleration node benchmarks and the --vram-headroom trick — spartong945 · 2026-09-11
- Midjourney style code share: --sref 2912175708 — tisch_eins · 2026-09-11