原帖引用 · 原文
该语言的正文暂不可用,当前显示已有版本。
Rohan Paul@rohanpaul_ai
OXR tags every block on a page as 1 of 13 element types and gives each type its own output format, so tables come out as HTML or Markdown, formulas and chemical equations as LaTeX, molecules as SMILES (a one-line text code for a chemical structure), and page headers and footers are dropped by default so they don’t clutter the main text.
SoMark open-sourced OXR-1.0, a 1.3B-parameter document parsing model that turns PDFs and page images into Markdown or JSON,
> It ranks first on olmOCR-Bench, OmniDocBench and DocParsingBench while being the fastest of 21 models tested.
> runs on a single 24GB GPU for light testing
Its post-training uses a recursive self-improvement (RSI) loop that turns the model’s own parsing mistakes into new training data, with no human labeling, a first in document parsing.
Parsing a page means finding every block (title, paragraph, table, formula), reading each one, and putting them in human reading order.
Most parsers tie layout detection to recognition or to reading order, which makes layout hard to retune for a new kind of document.
OXR splits it out: a small layout model draws a box around each block, and the 1.3B OXR model reads every box and sets the reading order, so a team can swap in its own layout model and keep the rest.
It outputs 13 element types with page coordinates, including tables, math as LaTeX (the text format scientists use for equations), code blocks, stamps and chemical structures.
In the RSI loop, OXR parses each training page several times, and a general vision language model (VLM) marks the result correct, wrong, or uncertain (meaning OXR’s own runs disagreed).
The VLM then writes a reason for each failure, and those reasons are grouped into clusters of the same weakness.
For each cluster, the VLM generates new labeled pages styled after a different real document each time, and OXR trains on them before the next round.
> On a single NVIDIA RTX PRO 6000 GPU, it decodes 558 tokens per second and parses 100 pages end to end in about 101 seconds, which is 3.05x GLM-OCR’s page throughput and 33.5% ahead of the next-fastest model, OvisOCR2.
> The weights are on Hugging Face, it runs on a single 24GB GPU for light testing, and a free API works without an account or key.
The accuracy lead is thin on olmOCR-Bench (0.24 points) and OmniDocBench (0.27 points), but OXR gets there while parsing pages about 64x faster than Infinity-Parser2-Pro, the olmOCR-Bench runner-up.
The RSI loop works as automatic hunting for the model’s hardest cases, with one general VLM acting as both judge and label writer, so the loop can only fix errors that VLM can spot.
在 X 查看这条帖子 ↗
· UTC+8