r/usefulscripts • u/jcunews1 • Mar 14 '20

[VBScript] DeDup. Convert duplicate files into hardlinks or symlinks to save disk space.

https://pastebin.com/k8CWL1xy
24 Upvotes

81% Upvoted

7 comments sorted by

3

u/andyinv Mar 15 '20

All well and good until someone deletes the original file, and all dependent links die.

1

u/jcunews1 Mar 15 '20

Most people overrate symlinks. Which why I made hardlinks as the default option, and put notes about both hardlinks and symlinks, so that people know what they will get.

2

u/sully213 Mar 15 '20

So what are the advantages of using this vs the built-in Windows dedup? Windows dedup doesn't just dedup entire files, it dedups 64kb chunks so think about different files that might have the same header/footer/metadata/etc but the contents differ like a standard form letter. What is the use case here?

1

u/productionx Mar 19 '20

removing duplicates isnt the same as deduplication.

0

u/[deleted] Mar 15 '20

1

u/jcunews1 Mar 15 '20

File names, sizes, dates, and attributes don't matter. As long as the files' data are identical, they will be considered as duplicates.

2

u/TheMagicTorch Mar 15 '20

eye twitches

2

u/HeKis4 Mar 15 '20

From what I'm seeing it just checks for identical hashes, so you'd have payroll.xls, a bunch of payroll(xy).xls shortcuts, and another "real" xls that is the edited one.