Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

change dedup to use one key and do auto-cleanup of the dedup kv store #1168

Merged
merged 1 commit into from
Jul 18, 2019

Conversation

bofm
Copy link
Contributor

@bofm bofm commented Jan 21, 2019

Changed deduplication to achieve the following:

  • use one kv key for both lock and data in consul-template/dedup/<md5>/data
  • automatically cleanup deduplication data in Consul kv store using Consul Sessions

fixes #1158

@hashicorp-cla
Copy link

hashicorp-cla commented Jan 21, 2019

CLA assistant check
All committers have signed the CLA.

@pearkes pearkes added this to the v0.20.0 milestone Feb 6, 2019
@pearkes
Copy link
Contributor

pearkes commented Feb 15, 2019

@bofm Thanks for the contribution. We'd like to land it with a few minor changes, but are you able to sign the CLA?

@pearkes pearkes removed this from the v0.20.0 milestone Feb 15, 2019
@bofm
Copy link
Contributor Author

bofm commented Feb 16, 2019

I don't want to sign it.

What would you like to change in the implementation?

Copy link
Contributor

@kyhavlov kyhavlov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bofm This PR looks good and can pretty much be merged as-is (just one minor comment) but we can't merge it unless you sign the CLA. Would you be able to look through the above CLA link (here) and reconsider?

manager/dedup.go Outdated
@@ -32,7 +32,8 @@ const (

// templateDataFlag is added as a flag to the shared data values
// so that we can use it as a sanity check
templateDataFlag = 0x22b9a127a2c03520
templateDataFlag = 0x22b9a127a2c03520
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This can get removed now since it's not used anywhere.

@bofm
Copy link
Contributor Author

bofm commented Feb 20, 2019

Can you please re-run the tests

@bofm
Copy link
Contributor Author

bofm commented Mar 7, 2019

All signed. Can it be merged?

@eikenb eikenb added the bug label Jun 14, 2019
@eikenb eikenb added this to the v0.20.1 milestone Jun 14, 2019
@eikenb eikenb added the dedup label Jun 18, 2019
@eikenb eikenb merged commit 4b14a64 into hashicorp:master Jul 18, 2019
@eikenb
Copy link
Contributor

eikenb commented Jul 18, 2019

Merged and will be part of upcoming release. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Dedup data is not cleaned up in Consul KV storage
5 participants