Home Upgrade Search Memberlist Extras Hacker Tools Award Goals Help Wiki Contact

Python 

Finding duplicates in directory

There you have it, hopefully this will help someone.

http://pastebin.com/iZAN34d0
(Feb 4, 2014 03:57 AM)PigBacon Wrote:  What if I've got a few gigs worth of distro isos in my dir? Reading everything into memory isn't a great idea - best to use a streaming OpenSSL method to hash, don't you think?

I definitely know this is not the best way to do this, but hey, it's something! Might be useful for some situation but not for big amounts of data/files, OR then just revise the code and find another way :P


Possibly Related Threads...
Thread / Author Replies Views Last Post
[Python] by essie98927Apr 25, 2022 02:40 AM 4 176 Apr 25, 2022 02:40 AM
Last Post: essie98927
[.NET] by SIM-3327349Aug 20, 2017 02:43 PM 6 235 Aug 20, 2017 02:43 PM
Last Post: SIM-3327349
[.NET] by GørillaFeb 28, 2017 07:24 AM 13 451 Feb 28, 2017 07:24 AM
Last Post: Gørilla