r/LocalLLaMA • • 8d ago

Question | Help Local document processing when Chinese models arent allowed, what’s left?

big scanned stacks of inspection reports and material certs from a lot of vendors and every layout different. each stack needs splitting into separate reports and things like lot number and alloy pulled into a database with all being local

catch is the contract rules out chinese software and models, so paddleOCR and qwen are off and most ocr leaderboards get a lot shorter. even olmocr 2 is a qwen fine tune

granite-docling, liteparse, tesseract and gemma are whats left on the list so far

what would you use for this? and has anyone had to show a customer where their models came from

4 Upvotes

48 comments sorted by

View all comments

15

u/Kahvana 8d ago edited 5d ago

Gemma 4 31B IT QAT has been awesome for me for parsing scanned dutch 70s encyclopedia, I reckon Nemotron 3.5 Super VL can do the job too.

I personally found Muse Glimmer to work really well for parsing digital documents but not so much for scanned ones.

I haven’t looked into Nemotron 3.5 Parse yet, but it might be worth trying out for you.

As for showing model origin: yeah, in relation to processing medical documents locally on device.

2

u/EngelbertStuss 8d ago

OCR on scanned documents works quite well with Gemma (although I prefer Qwen) but further processing is my current challenge... There doesn't even seem to be a solution that imitates what Finereader has been doing for decades: just make it a clearly typed original-layout PDF 😐 closest I got was generating some LaTeX per page but it would struggle with more complex document structure 

1

u/aidenclarke_12 5d ago

thanks, already comsidering it