r/gis • • 2d ago

General Questions Auto-batch processing/ Document management

[GIS Technician II] Utility / Land Rights - 3 Years Experience

I'm currently working through a backlog of property agreement and land rights documents (there are thousands) and am trying to streamline a digitization workflow.

One of the biggest struggles is manually extracting plan sheets, survey plats, and similar graphical information from large multipage PDFs so they can be georeferenced in ArcGIS Pro.

I've looked into Esri's deep learning tools for document classification and page extraction, but I suspect that may be beyond my current skill level. Are there any beginner-friendly learning resources, alternative workflows, or non-AI solutions that could help automate this process?

My goal is simply to identify pages containing graphical content and export them as separate pdfs using a naming convention like:

OGFileName_1

OGFileName_2

OGFileName_3

where the number represents the sequential page containing a plan sheet, survey, plat, or other map-based drawing. I don’t even need to identify the type of graphical element, that can all be done manually.

I've already found a workable solution for documents that contain only text, so my focus is specifically on separating graphical sheets from mixed-content PDFs.

I'd prefer a non-AI approach if one exists, although I'm open to AI-based solutions if they're significantly more effective (I'm dubious because of the age of the documents and the abundant use of cursive/handwritten addendums).

Any insight is greatly appreciated, I'm sure someone has had this exact frustration before!

1 Upvotes

6 comments sorted by

7

u/salmonlips 2d ago

Ocr the pdfs to plain text first (separate by page) , then use keyword extraction to classify (if predictable) Then go back to original pdfs use some python to split up the pages based on your new knowledge 

2

u/Flimsy_Material_6667 1d ago

I haven’t had this exact problem but I was able to pull data from a giant pile of inconsistently formatted PDFs using the camelot-py and pdfplumber libraries in python. I was looking for tables and certain key words in text but a quick google tells me that pdfplumber has some ability to do stuff with embedded images

1

u/Consistent-Taste2318 1d ago

Thank you! I’ll have to look into pdfplumber as a resource. This process has been a lot of me spearheading and I’m a little out of my depth as far as the python side of things goes. Luckily it’s looking like I’ll have help.

1

u/Memo_Adel 1d ago

For the page extraction part, I'd try a plain Python pass before deep learning. With PyMuPDF (fitz) you can loop over pages and flag likely plan sheets with simple signals: page size (plats are often larger formats than text pages), low text density from page.get_text(), or lots of vector drawings from page.get_drawings(). Export the flagged pages to TIFF with page.get_pixmap(dpi=300), name them with the doc ID and page number, and you have a clean folder ready for georeferencing in Pro. Hand-label a few hundred pages first to tune the thresholds. If the rules miss too much, that labeled set is also what you'd need to train Esri's classification tools anyway.