Ferrous Moon
http://www.ferrousmoon.com:80/forums/

World biggest MD5/[other hash] database
http://www.ferrousmoon.com:80/forums/viewtopic.php?f=45&t=1941
Page 1 of 1

Author:  ChaosR [ Tue Nov 17, 2009 8:22 am ]
Post subject:  World biggest MD5/[other hash] database

Well, how would you do it.

Requirements
Must be able to return an answer within a second or-so (so no rainbow tables)
Space efficiency is probably the most important factor, because these databases tend to be _HUGE_.

How I would go about it
Storing the MD5's on disk in a probably RB-tree index'ed way. Compression could helpful. I don't really know what more to say :classy:.

EDIT: Gheh, I described my first method in a way that would just store the MD5, no way to restore it (just what the md5 function does), now that was embarrassing :P

EDIT2:
More advanced solution, observing that MD5 is a hashing function, using this to build a DHT across a huge number of ever expanding nodes can be a good help. Still the same principle in the end though.

Author:  prophile [ Wed Nov 18, 2009 2:05 am ]
Post subject:  Re: World biggest MD5/[other hash] database

DHT.

Author:  Rickton [ Wed Nov 18, 2009 1:41 pm ]
Post subject:  Re: World biggest MD5/[other hash] database

Quote:
DHT.
Or DMT. :sleazy:

Page 1 of 1 All times are UTC-05:00
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
http://www.phpbb.com/