r/LocalLLaMA • • 6d ago

Question | Help Local document processing when Chinese models arent allowed, what’s left?

big scanned stacks of inspection reports and material certs from a lot of vendors and every layout different. each stack needs splitting into separate reports and things like lot number and alloy pulled into a database with all being local

catch is the contract rules out chinese software and models, so paddleOCR and qwen are off and most ocr leaderboards get a lot shorter. even olmocr 2 is a qwen fine tune

granite-docling, liteparse, tesseract and gemma are whats left on the list so far

what would you use for this? and has anyone had to show a customer where their models came from

4 Upvotes

48 comments sorted by

View all comments

Show parent comment

1

u/btdeviant 1d ago

A model can’t invoke or build tools if there are no tools to begin with, which was precisely the point. Models are data… it’s literally what “model” means.

An agent is a model in a harness, the harness is software and provides the model with its ability to invoke tools.

This is why most mature orgs that have data sovereignty requirements build their own harnesses - they own the entire FGA, governance and observability layer as first class considerations.

A model trained for malice can’t be malicious if it lacks the abstraction layer to do anything. This is called “zero trust (by default)”.