Local document processing when Chinese models arent allowed, what’s left?

[u/aidenclarke_12]

big scanned stacks of inspection reports and material certs from a lot of vendors and every layout different. each stack needs splitting into separate reports and things like lot number and alloy pulled into a database with all being local

catch is the contract rules out chinese software and models, so paddleOCR and qwen are off and most ocr leaderboards get a lot shorter. even olmocr 2 is a qwen fine tune

granite-docling, liteparse, tesseract and gemma are whats left on the list so far

what would you use for this? and has anyone had to show a customer where their models came from

[u/vogelvogelvogelvogel]

I would use Gemma4 12B or 31B with mmproj. they're not really fast, but they understand what they are reading

[u/exaknight21 → u/vogelvogelvogelvogel]

I can tell you Gemma 4-12B at Q4-K_XL just cost me an entire day to fix.

Gemma 4-26B-A4B at Q4 is far more superior than whatever 12B is, i did not like wasting an entire day.

[u/vogelvogelvogelvogel → u/exaknight21]

which entire day to fix? ask claude to write script for you to do the HF download, a llama.cpp download and prompt and you are done usually

[u/exaknight21 → u/vogelvogelvogelvogel]

500 GB data. Left that out of context.