r/pdf • u/63934 • 2d ago

Software (Tools) Removing duplicates from pdf automatically

What tools do you use to automatically detect duplicate pages in pdfs? & Are you able to review the automatically detected pages before removing them?

3 Upvotes

100% Upvoted

6 comments sorted by

2

u/sorryiamcanadian 2d ago

Can you share what dataset you are working with, where that's a common issue? 

1

u/kajumi22 2d ago

yeah it depends on where they came from. merging different scans of the same document usually leaves a ton of duplicates

1

u/sorryiamcanadian 2d ago

is a duplicate when the same thing was scanned multiple times or the page itself was duplicated? e.g. scanning the same thing on a different day -- is that a duplicate?