aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

SoMark 开放文档解析模型 OXR-1.0 权重及免费 API

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

OXR-1.0 可将 PDF 和页面图片解析为 Markdown 或 JSON,并识别表格、公式等内容及其阅读顺序。SoMark 称其在三项文档解析基准测试中排名第一;模型权重已上架 Hugging Face,免费 API 无需账号或密钥,但轻量测试仍需单张 24GB 显存的 GPU。

原帖引用 · 原文

@rohanpaul_ai

SoMark open-sourced OXR-1.0, a 1.3B-parameter document parsing model that turns PDFs and page images into Markdown or JSON,

> It ranks first on olmOCR-Bench, OmniDocBench and DocParsingBench while being the fastest of 21 models tested.

> runs on a single 24GB GPU for light testing

Its post-training uses a recursive self-improvement (RSI) loop that turns the model’s own parsing mistakes into new training data, with no human labeling, a first in document parsing.

Parsing a page means finding every block (title, paragraph, table, formula), reading each one, and putting them in human reading order.

Most parsers tie layout detection to recognition or to reading order, which makes layout hard to retune for a new kind of document.

OXR splits it out: a small layout model draws a box around each block, and the 1.3B OXR model reads every box and sets the reading order, so a team can swap in its own layout model and keep the rest.

It outputs 13 element types with page coordinates, including tables, math as LaTeX (the text format scientists use for equations), code blocks, stamps and chemical structures.

In the RSI loop, OXR parses each training page several times, and a general vision language model (VLM) marks the result correct, wrong, or uncertain (meaning OXR’s own runs disagreed).

The VLM then writes a reason for each failure, and those reasons are grouped into clusters of the same weakness.

For each cluster, the VLM generates new labeled pages styled after a different real document each time, and OXR trains on them before the next round.

> On a single NVIDIA RTX PRO 6000 GPU, it decodes 558 tokens per second and parses 100 pages end to end in about 101 seconds, which is 3.05x GLM-OCR’s page throughput and 33.5% ahead of the next-fastest model, OvisOCR2.

> The weights are on Hugging Face, it runs on a single 24GB GPU for light testing, and a free API works without an account or key.

The accuracy lead is thin on olmOCR-Bench (0.24 points) and OmniDocBench (0.27 points), but OXR gets there while parsing pages about 64x faster than Infinity-Parser2-Pro, the olmOCR-Bench runner-up.

The RSI loop works as automatic hunting for the model’s hardest cases, with one general VLM acting as both judge and label writer, so the loop can only fix errors that VLM can spot.

来源:Rohan Paul · x.com

产品
发现内容有误?提交纠错