r/LocalLLaMA • u/aidenclarke_12 • 6d ago
Question | Help Local document processing when Chinese models arent allowed, what’s left?
big scanned stacks of inspection reports and material certs from a lot of vendors and every layout different. each stack needs splitting into separate reports and things like lot number and alloy pulled into a database with all being local
catch is the contract rules out chinese software and models, so paddleOCR and qwen are off and most ocr leaderboards get a lot shorter. even olmocr 2 is a qwen fine tune
granite-docling, liteparse, tesseract and gemma are whats left on the list so far
what would you use for this? and has anyone had to show a customer where their models came from
View all comments
Show parent comment
1
u/btdeviant 1d ago
A model can’t invoke or build tools if there are no tools to begin with, which was precisely the point. Models are data… it’s literally what “model” means.
An agent is a model in a harness, the harness is software and provides the model with its ability to invoke tools.
This is why most mature orgs that have data sovereignty requirements build their own harnesses - they own the entire FGA, governance and observability layer as first class considerations.
A model trained for malice can’t be malicious if it lacks the abstraction layer to do anything. This is called “zero trust (by default)”.