Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use XXH64 instead of MD5 #108

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Conversation

adamfur
Copy link

@adamfur adamfur commented Jun 7, 2018

Switching to a more CPU friendly hash algorithm that is 100x faster than MD5.
Both XXH64 and MD5 have quality index of 10 in SMHasher.

Also confirmmatch() is run prior to erasure.

@@ -0,0 +1,3 @@
[submodule "xxHash"]
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You're changing the build instructions here. It's not possible to just do a normal clone of the repo and fire a make call anymore.

Looking at the current master, It's general not a good advice having no build instructions at all. But you're introducing a stupid trap door here, which warrants a comment a.k.a. build documentation.

While reading the XXH64 website, it looks pretty promising.

@ErwanAliasr1
Copy link

I'm running on an ARM based system where cpu counts. Can you rebase this PR ?

@adamfur
Copy link
Author

adamfur commented Nov 15, 2018

Didn't seem like a whole lot of interest to have it merged.
Perhaps just use the master branch from my repo?

@ErwanAliasr1
Copy link

Rebasing would be better so it if works fine we can ask for a merge ;)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants