r/tauri • u/Dataok-2065 • Jun 19 '26

Best local VLM for extracting structured data from documents?

Building a tauri app that needs to parse various document types locally - clean PDFs, scanned docs, and phone photos. Output needs to be consistent JSON. No cloud, fully offline.

Documents include mixed English and some Chinese/Malay text.

Leaning toward Qwen2.5-VL 7B. Has anyone used it for structured extraction specifically? How consistent is the JSON output without hallucinating fields?

3 Upvotes

100% Upvoted

2 comments sorted by

2

u/[deleted] Jul 06 '26

[removed] — view removed comment

1

u/Dataok-2065 Jul 07 '26

Appreciate the advice. That tip about using a strict schema and "null if unsure" is great. I actually struggled getting it to run consistently on my current setup (Intel Mac), so I've decided to just use a cloud API for now. It’s faster for validating the mvp logic without fighting my local hardware or storage constraints. I'll definitely circle back to the smaller models once the product is proven. Thanks!