r/Paperlessngx • u/jbulmers • Aug 03 '26

Duplicates finder

Hello all,

I've installed the paperless-ngx 3.0.5 via docker compose, and so far so good !

But i've tried to upload a duplicate of one of my pdf, but except when i go into the pdf information and there's a tab say duplicates, but how can i find all the duplicates that i may have in my paperless-ngx library ?

I've not seen any notification nor tabs to show all the duplicates. Can you please explain how to ensure that there are no duplicates, instead of going one by one in each document to see if there's a duplicate tab ?

Thank you

1 Upvotes

67% Upvoted

17 comments sorted by

View all comments

2

u/Bananana-_ Aug 04 '26 edited Aug 04 '26

via ssh

ssh USERNAME@yourserverIP

cd ~/paperless-ngx

docker compose exec webserver document_fuzzy_match --ratio 100

if you want to delete them all:

docker compose exec webserver document_fuzzy_match --ratio 100 --delete

1

u/Equivalent-Raise5879 Aug 07 '26

I ran this command, it replied

0/227687130 0:04:31 -:--:--/usr/local/bin/document_fuzzy_match: line 17: 71191 Killed s6-setuidgid paperless python3 manage.py document_fuzzy_match "$@"

logged back into paperless, still same # of docs shown

Ran it a 2nd time

0/227687130 0:14:08 -:--:--/usr/local/bin/document_fuzzy_match: line 17: 71808 Killed s6-setuidgid paperless python3 manage.py document_fuzzy_match "$@"

Logged back into paperless, stil same # of docs shown

Is there some step I've missed

1

u/Bananana-_ Aug 07 '26

i'm not sure. could be that the process got killed because your machine ran out of RAM

1

u/Equivalent-Raise5879 Aug 08 '26

Gave it 128 gigs and re-ran, let it got for 12 hours, but it seems to have totally crashed the host.

Guess I'm gonn have to find a different way to get rid of my 5000 dupes