memosstilvi / simhash Goto Github PK

hello
if i initiate the constructor with 64 bit parameter, i get this error
hash = simhash2.simhash(y.encode('utf-8'), 64)

any work around ?

Hello
nice work ! thank for sharing.
can you add a method to compare a list of hashes ? I mean, i have a collection of 5000 documents, i used this code to calculate the simhash for each. and now, i want to detect duplicates.

thanks for your help

1. doc needs to convert into string to proceed further for re
   doc = str(doc).lower() # convert into string to handle error if input is else

2. while converting into binary from md5 encoding required to mention
   h = bin(int(md5(token.encode('utf-8')).hexdigest(), 16)) # to handle encoding error

3. Python version update to call dictionary items in 3.0
   for _, token in token_dict.items(): # instead of iteritems() in python version 2.0 replaced with items() in python 3.0

if __name__ == '__main__':
    # Just for demonstration
    doc = data # {doc_id, doc}
    binary_hash = simhash(doc)
    print(binary_hash)