Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Correctly prioritize snapshot requests #86456

Conversation

andrewbaptist
Copy link
Collaborator

@andrewbaptist andrewbaptist commented Aug 19, 2022

kv: Priority sending and receiving snapshots

Previously on both the send and receive snapshot side, the various places that sent snapshots were uncoordinated, and the choice of which snapshot was sent was somewhat arbitrary. Snapshots use a fair round-robin approach for choosing which one to send next. Decommissioning will be considerably faster with this change.

This PR uses the new multiqueue to prioritize them correctly.

Release note (performance improvement): Snapshot starvation for specific types will no longer occur.
Release Justification: A large number of customer support cases have occurred due to incorrect receive side snapshot prioritization. Additionally decommissioning will complete faster after this change.

@andrewbaptist andrewbaptist linked an issue Aug 19, 2022 that may be closed by this pull request
@cockroach-teamcity
Copy link
Member

This change is Reviewable

@andrewbaptist andrewbaptist force-pushed the correctly-prioritize-snapshot-requests branch 8 times, most recently from 4ab03ad to 0109a30 Compare August 22, 2022 14:13
Previously on both the send and receive snapshot side, the
various places that sent snapshots were uncoordinated, and
the choice of which snapshot was sent was somewhat arbitrary.
This PR uses the new multiqueue to prioritize them correctly.

Release note (performance improvement): Snapshots use a fair
round-robin approach for choosing which one to send next.

Release Justification: A large number of customer support
cases have occurred due to incorrect receive side snapshot
prioritization. Decommissioning will complete faster with this
change.

Release justification:
@andrewbaptist andrewbaptist force-pushed the correctly-prioritize-snapshot-requests branch from 0109a30 to 9c338eb Compare August 22, 2022 17:26
@andrewbaptist
Copy link
Collaborator Author

This has been superseded by #86701

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

kv: Correctly prioritize snapshot requests
2 participants