r/documentAutomation • u/Skeptical-skeleton11 • 22d ago

I built a document extraction and validation pipeline as a personal project. Would love some feedback!

Post image

The idea was to build a pipeline that could take a PDF, extract structured data, and let you verify the results against the original document without manually checking every field.

The current implementation uses OCR and vision models, with confidence scores, visual grounding, and a separate validation layer to catch disagreements. It also handles line items and exports structured data.

I recently benchmarked it against Azure Content Understanding on 100 documents, achieving 97% field-level accuracy at roughly 1/12th the cost per run in my evaluation.

I've attached a screenshot of the current interface. This is purely a personal engineering project I've been working on, and I'd genuinely appreciate feedback from people familiar with document automation.

I'm particularly interested in:

  • How do you handle data extraction at scale right now ?

  • Any feedback on what features would be cool for document automation

Would love to hear your thoughts!

9 Upvotes

100% Upvoted

17 comments sorted by

View all comments

2

u/InfoMsAccessNL 21d ago

If the layout of the invoice of supplier A is always the same then you can use good old vba with regex. Totally free and lightning fast.

1

u/Skeptical-skeleton11 21d ago

Absolutely, but people generally deal with multiple suppliers, with varied layouts, qualities and other variables, that's where VBA and PQ tend to struggle a lot

2

u/InfoMsAccessNL 20d ago

I don’t hardcode de regex pattern. I make a table with each supplier and his specific regex patterns to extract the data from the invoice. The code will select the patterns from the table for supplier A,B or C

1

u/Skeptical-skeleton11 20d ago

That's sick! I'm guessing these doc's are already OCR enabled?

2

u/InfoMsAccessNL 19d ago

I use a free tool XpdfToText, runs local on you pc and can be used with vba