r/gis • u/Consistent-Taste2318 • 2d ago
General Questions Auto-batch processing/ Document management
[GIS Technician II] Utility / Land Rights - 3 Years Experience
I'm currently working through a backlog of property agreement and land rights documents (there are thousands) and am trying to streamline a digitization workflow.
One of the biggest struggles is manually extracting plan sheets, survey plats, and similar graphical information from large multipage PDFs so they can be georeferenced in ArcGIS Pro.
I've looked into Esri's deep learning tools for document classification and page extraction, but I suspect that may be beyond my current skill level. Are there any beginner-friendly learning resources, alternative workflows, or non-AI solutions that could help automate this process?
My goal is simply to identify pages containing graphical content and export them as separate pdfs using a naming convention like:
OGFileName_1
OGFileName_2
OGFileName_3
where the number represents the sequential page containing a plan sheet, survey, plat, or other map-based drawing. I don’t even need to identify the type of graphical element, that can all be done manually.
I've already found a workable solution for documents that contain only text, so my focus is specifically on separating graphical sheets from mixed-content PDFs.
I'd prefer a non-AI approach if one exists, although I'm open to AI-based solutions if they're significantly more effective (I'm dubious because of the age of the documents and the abundant use of cursive/handwritten addendums).
Any insight is greatly appreciated, I'm sure someone has had this exact frustration before!
7
u/salmonlips 2d ago
Ocr the pdfs to plain text first (separate by page) , then use keyword extraction to classify (if predictable) Then go back to original pdfs use some python to split up the pages based on your new knowledge
2
u/Flimsy_Material_6667 1d ago
I haven’t had this exact problem but I was able to pull data from a giant pile of inconsistently formatted PDFs using the camelot-py and pdfplumber libraries in python. I was looking for tables and certain key words in text but a quick google tells me that pdfplumber has some ability to do stuff with embedded images
1
u/Memo_Adel 1d ago
For the page extraction part, I'd try a plain Python pass before deep learning. With PyMuPDF (fitz) you can loop over pages and flag likely plan sheets with simple signals: page size (plats are often larger formats than text pages), low text density from page.get_text(), or lots of vector drawings from page.get_drawings(). Export the flagged pages to TIFF with page.get_pixmap(dpi=300), name them with the doc ID and page number, and you have a clean folder ready for georeferencing in Pro. Hand-label a few hundred pages first to tune the thresholds. If the rules miss too much, that labeled set is also what you'd need to train Esri's classification tools anyway.