0.8B-Parameter OvisOCR3 Leads Five OCR Tasks at Once
A team of 15 researchers has introduced OvisOCR3, a compact 0.8B-parameter model. A single set of weights covers five tasks: document parsing, general OCR, key information extraction, figure captioning, and assembling tables split across pages. On OmniDocBench v1.6 the model scores 96.74, and it takes first place on OCRBench v2: 65.9 on the English split and 61.3 on the Chinese split. Five domain-specific 4B teachers distilled their knowledge into it. • Leads on PureDocBench, Real5-OmniDocBench and MDPBench • Outperforms the baseline models on all four KIE benchmarks • Comes close to Qwen3.8-Max on figure captioning
AI-processed from arXiv cs.CV; edited by Hamidun News
A team of 15 authors has released OvisOCR3, a 0.8B-parameter model that handles five tasks with a single set of weights: document parsing, general OCR, key information extraction (KIE), captioning of figures in documents, and assembling tables that stretch across several pages. On OmniDocBench v1.6 it scores 96.74, and on OCRBench v2 it takes first place: 65.9 on the English split and 61.3 on the Chinese split. It is compared against general-purpose VLMs and narrowly specialized OCR models, and by the authors' reported results, the small model beats many of them.
Five teachers for one student
The main contribution is how the model was trained. The authors first ran continued pretraining on a mix of real and synthetic data. They then added domain-balanced mid-training. The tasks differ sharply in data volume and answer length. Parsing a full page into markup produces thousands of tokens, while extracting a couple of fields from a receipt takes only a few lines. Without balancing, the long domains would easily swamp the short ones, and this stage evens out each domain's contribution to training.
Next comes multi-teacher on-policy distillation. Five domain-specific teachers, each 4B in size, pass their skills to a general model that is five times smaller than any of them. On-policy distillation means the student trains on its own generations, which the teachers then evaluate. The final step is mixed-task reinforcement learning with per-domain rewards: tables, captions and field extraction each use different quality criteria.
Where OvisOCR3 comes out ahead
The authors compare the model on public and internal benchmarks across all five task families. Results according to their data:
- OmniDocBench v1.6 — overall score of 96.74.
- PureDocBench, Real5-OmniDocBench, MDPBench — the highest overall score among the compared models.
- OCRBench v2 — first place: 65.9 (English split) and 61.3 (Chinese split).
- OCRBench — higher than all baseline models.
- Four KIE benchmarks — higher than the baseline models on each.
- DocFigCapBench — the best localization F1 and caption quality close to Qwen3.8-Max.
- CrossTabBench — leads on Relation F1 for multi-page tables.
- MPDocBench-Parse — the best TEDS on truncated tables.
Figure captioning deserves a closer look. Here the 0.8B model nearly catches up with Qwen3.8-Max, and it beats every other model in the comparison on the accuracy of locating figures on the page. This task sits at the intersection of vision and language, where large general-purpose VLMs usually win.
Tables that don't fit on one page
Cross-page tables remain a weak spot for many OCR pipelines. A financial report, a specification or a statement often carries a table over to the next sheet with a repeated or missing header. A conventional parser sees two independent fragments, and the structure falls apart. Relation F1 on CrossTabBench and TEDS on the truncated tables of MPDocBench-Parse measure exactly this ability to restore the links between parts. Leading on both suggests the model understands the document as a whole, not page by page.
Who should take a look
One model instead of a set of specialized ones simplifies the architecture. You don't need separate services for parsing, KIE and image captioning, you don't have to reconcile their output formats, and you don't have to keep an on-call rotation for each. At 0.8B, the model promises cheap inference and the ability to run on modest hardware, although the authors do not publish cost comparisons, and you will have to check speed yourself.
Teams that build RAG over PDFs, process contracts, invoices and reports, or digitize Chinese and English documents get a candidate for a quick test. It is best to start with your hardest documents, the ones with multi-page tables and complex figures. Results on your own data will show how well the benchmark numbers carry over to production. The recipe itself, with domain teachers, distillation and RL with different rewards, also looks like a reproducible approach for other multi-domain tasks where several specialists need to fit into one compact model.
- Oct 28, 2026Liquid AI releases LFM2.5-24B-A2B: an agent model with 2B active parameters
- Oct 28, 2026Switzerland's Apertus 1.5 Gains Vision, Hearing and a 262K-Token Context Window
- Oct 28, 2026AWS Launches Multi-Turn RL in SageMaker: gpt-oss-20b Climbs From 15% to 69% for $339
- Oct 28, 2026Microsoft and Hugging Face trained Qwen3.8-27B on database-state rewards: from 38 to 107 tasks
Key Questions Answered
What are the key details on Five teachers for one student?
The main contribution is how the model was trained. The authors first ran continued pretraining on a mix of real and synthetic data. They then added domain-balanced mid-training. The tasks differ sharply in data volume and answer length. Parsing a full page into markup produces thousands of tokens, while extracting a couple of fields from a receipt takes only a few lines. Without balancing, the long domains would easily swamp the short ones, and this stage evens out each domain's contribution to training. Next comes multi-teacher on-policy distillation. Five domain-specific
Where OvisOCR3 comes out ahead?
The authors compare the model on public and internal benchmarks across all five task families. Results according to their data: OmniDocBench v1.6 — overall score of 96.74. PureDocBench, Real5-OmniDocBench, MDPBench — the highest overall score among the compared models. OCRBench v2 — first place: 65.9 (English split) and 61.3 (Chinese split). OCRBench — higher than all baseline models. Four KIE benchmarks — higher than the baseline models on each. DocFigCapBench — the best localization F1 and caption quality close to Qwen3.8-Max. CrossTabBench — leads on Relation F1 for mult
What are the key details on Tables that don't fit on one page?
Cross-page tables remain a weak spot for many OCR pipelines. A financial report, a specification or a statement often carries a table over to the next sheet with a repeated or missing header. A conventional parser sees two independent fragments, and the structure falls apart. Relation F1 on CrossTabBench and TEDS on the truncated tables of MPDocBench-Parse measure exactly this ability to restore the links between parts. Leading on both suggests the model understands the document as a whole, not page by page.
Test Frontier LLMs & Autonomous Agents in One Workspace
Run Claude Opus 5.5, GPT-6, Gemini 3.1, and DeepSeek side-by-side in Nomad AI (nomadnet.ai) — unified model routing, deep research, and multimodal workflows under one subscription.
The AI world, distilled — once a week
Seven stories that actually mattered, hand-picked. No noise, no reposts, no press releases.
Done! Check your inbox for a confirmation.