aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

SoMark 开放 OXR-1.0 权重,提供文档解析免费 API

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

SoMark 开放了 13 亿参数文档解析模型 OXR-1.0 的权重,并提供无需账号或密钥的免费 API。它可将 PDF 和页面图像转为 Markdown 或 JSON,识别表格、公式等页面元素;其训练循环用模型解析错误生成新数据,但只能修正辅助视觉语言模型能发现的错误。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

OXR tags every block on a page as 1 of 13 element types and gives each type its own output format, so tables come out as HTML or Markdown, formulas and chemical equations as LaTeX, molecules as SMILES (a one-line text code for a chemical structure), and page headers and footers are dropped by default so they don’t clutter the main text.

回复Rohan Paul@rohanpaul_ai
SoMark open-sourced OXR-1.0, a 1.3B-parameter document parsing model that turns PDFs and page images into Markdown or JSON, > It ranks first on olmOCR-Bench, OmniDocBench and DocParsingBench while being the fastest of 21 models tested. > runs on a single 24GB GPU for light testing Its post-training uses a recursive self-improvement (RSI) loop that turns the model’s own parsing mistakes into new training data, with no human labeling, a first in document parsing. Parsing a page means finding every block (title, paragraph, table, formula), reading each one, and putting them in human reading order. Most parsers tie layout detection to recognition or to reading order, which makes layout hard to retune for a new kind of document. OXR splits it out: a small layout model draws a box around each block, and the 1.3B OXR model reads every box and sets the reading order, so a team can swap in its own layout model and keep the rest. It outputs 13 element types with page coordinates, including tables, math as LaTeX (the text format scientists use for equations), code blocks, stamps and chemical structures. In the RSI loop, OXR parses each training page several times, and a general vision language model (VLM) marks the result correct, wrong, or uncertain (meaning OXR’s own runs disagreed). The VLM then writes a reason for each failure, and those reasons are grouped into clusters of the same weakness. For each cluster, the VLM generates new labeled pages styled after a different real document each time, and OXR trains on them before the next round. > On a single NVIDIA RTX PRO 6000 GPU, it decodes 558 tokens per second and parses 100 pages end to end in about 101 seconds, which is 3.05x GLM-OCR’s page throughput and 33.5% ahead of the next-fastest model, OvisOCR2. > The weights are on Hugging Face, it runs on a single 24GB GPU for light testing, and a free API works without an account or key. The accuracy lead is thin on olmOCR-Bench (0.24 points) and OmniDocBench (0.27 points), but OXR gets there while parsing pages about 64x faster than Infinity-Parser2-Pro, the olmOCR-Bench runner-up. The RSI loop works as automatic hunting for the model’s hardest cases, with one general VLM acting as both judge and label writer, so the loop can only fix errors that VLM can spot.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

产品
发现内容有误?提交纠错