Home Upgrade Search Memberlist Extras Hacker Tools Award Goals Help Wiki Contact

[$100] I need to program to scan my external drive for duplicate files

I need a GOOD program to scan my computer (External USB drive) to find duplicates (Such as photos, music, videos ect.).

The program need to make sure that it is a correct 100% same file and not 2 different files in different folder but with the same name.

The program can have a software license that can cost up to €100+.

Can anyone recommend a Free / Paid software that can do this?

mistakes should not happen.
Here's an open source Python script written by me that does exactly that:

https://github.com/MonroCoury/PySpace

Description is in the readme.md
^First of all, big thanks for the rep!

I have researched the topic actually, and it turns out that the odds of 2 different files producing the same md5 hash code are practically negligibly small:

https://crypto.stackexchange.com/questio...n-unencryp

https://superuser.com/questions/556923/w...gth-giving

SHA-256 would lead to even more unlikely collisions, but the reason why I used md5 is because generating md5 hashes takes less time and resources.

Tho it is "theoretically" possible.. So I'll update the readme.
(Apr 20, 2017 06:23 PM)CaptainBlack Wrote:  Here's an open source Python script written by me that does exactly that:

https://github.com/MonroCoury/PySpace

Description is in the readme.md

Does the bot autoclean or Will i be able to see what files are duplicates?
CCleaner has duplicate finder, might be worth looking at.
(Apr 21, 2017 01:13 AM)Reporter Wrote:  Does the bot autoclean or Will i be able to see what files are duplicates?

It autocleans.. But you've brought up an interesting suggestion.. I'll add that soon.
(Apr 21, 2017 01:34 AM)CaptainBlack Wrote:  It autocleans.. But you've brought up an interesting suggestion.. I'll add that soon.

PM me or post in thread once it lets me see what files it will remove so I can double check.
🤝
Done! The script will now display the full path of all the files it will delete and ask you for confirmation. If you enter anything that isn't y or yes it will abort.


Possibly Related Threads...
Thread / Author Replies Views Last Post
by ChapmanMay 4, 2024 06:12 AM 9 233 May 4, 2024 06:12 AM
Last Post: happygonutty
by @DexterDec 1, 2017 03:03 PM 3 152 Dec 1, 2017 03:03 PM
Last Post: anonymous4qazqwert
by EffexionJan 13, 2017 09:37 AM 9 158 Jan 13, 2017 09:37 AM
Last Post: Malicious Intent