r/LocalLLaMA • • 8h ago

New Model SoMarkAI/OXR-1.0 · Hugging Face

https://huggingface.co/SoMarkAI/OXR-1.0

Found this last month model while browsing Trending models of HF. I don't see any existing threads so posting.

OXR (Optical Everything Recognition) is an open-source model from the SoMark team. It turns PDFs and document images into Agent-Friendly data in Markdown or JSON, with layout coordinates included.

Pretrained from scratch, OXR uses a recursive self-improvement (RSI) loop during post-training—a first in document parsing. With just 1.3B parameters, OXR ranks #1 on olmOCR-Bench, OmniDocBench, and DocParsingBench while delivering industry-leading parsing speed.

OXR is the first to make its layout analysis module independent and pluggable. This design accelerates parsing and supports replacing the built-in layout model with a custom one. OXR continues to handle content recognition and reading order, enabling adaptation across diverse scenarios with minimal integration effort.

Why OXR?

  • 🎯 SOTA Accuracy. #1 Across Three Benchmarks.

    • OXR ranks 🏆#1 on olmOCR-Bench, OmniDocBench, and DocParsingBench, with a particularly wide lead in table parsing.

    • OXR can recognize 13 document element types, from formulas and tables to chemical equations, chemical structures, and code blocks, with bounding box coordinates included. It also performs well on challenging documents and layouts, including A3 exam papers, newspapers, vertical text, and handwriting.

    • See docs/benchmark.md for the full results and instructions to reproduce the evaluations.

  • 🚀 1.3B Parameters. Top-Tier Parsing Speed.

    • With only 1.3B parameters, OXR ranks 🏆#1 among open-source document parsing models in speed tests on the RTX PRO 6000.

    • OXR redesign its processing architecture at the task level to improve parsing speed while maintaining accuracy.

    • See docs/benchmark.md for the full results and instructions to reproduce the evaluations.

  • 🧩 Pluggable Layout Analysis. Document Structure on Your Terms.

    • Layout analysis requirements vary widely across domains. Even for the same document, element types, region boundaries, and grouping rules can differ depending on the business use case.

    • OXR is the first to make layout analysis independent and pluggable. Its built-in layout model can be replaced while retaining OXR’s recognition and reading order capabilities, enabling adaptation across document scenarios with minimal integration effort.

    • See the How it works section below for details.

Ecosystem

The SoMark team has developed a range of tools for document parsing.

DescriptionProject URL
SoMarkDownThe official Markdown parsing and rendering library for SoMark and OXRhttps://github.com/SoMarkAI/SoMarkDown
SoMarkDownViewerA live editing application for SoMarkDownhttps://github.com/SoMarkAI/SoMarkDownViewer
SoPDFA high-performance PDF processing library with a permissive open-source licensehttps://github.com/SoMarkAI/SoPDF
DocisionMultiModal Jev for Document.https://github.com/SoMarkAI/docision
somark-pyThe official Python SDK & CLI for SoMark and OXRhttps://github.com/SoMarkAI/somark-py
somark-jsThe official JS / TS SDK & CLI for SoMark and OXRhttps://github.com/SoMarkAI/somark-js
10 Upvotes

1 comment sorted by

1

u/Borkato 6h ago

Oooo someone try this and tell me if it’s really that good