Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

upgrade: checkpoint fence version for multi-tenant clusters #104821

Merged

Conversation

jeffswenson
Copy link
Collaborator

@jeffswenson jeffswenson commented Jun 13, 2023

Previously, the tenant upgrade interlock checkpointed the version attached to the upgrade, when it should have checkpointed the fence version. This made it possible for an upgrade to skip versions. The conditions needed for this are rare, but could be triggered by crashes in the upgrade system or by the autoscaler downscaling a serverless cluster with multiple nodes.

Release Note: None

Fixes: #104884

@cockroach-teamcity
Copy link
Member

This change is Reviewable

@jeffswenson jeffswenson force-pushed the jeffswenson-fix-upgrade-interlock branch 2 times, most recently from 8e26e42 to 3a19c62 Compare June 14, 2023 14:27
@jeffswenson jeffswenson added the backport-23.1.x Flags PRs that need to be backported to 23.1 label Jun 14, 2023
Previously, the tenant upgrade interlock checkpointed the version
attached to the upgrade, when it should have checkpointed the fence
version. This made it possible for an upgrade to skip versions. The
conditions needed for this are rare, but could be triggered by crashes
in the upgrade system or by the autoscaler downscaling a serverless
cluster with multiple nodes.

Release Note: None

Fixes: cockroachdb#104884
@jeffswenson jeffswenson force-pushed the jeffswenson-fix-upgrade-interlock branch from 3a19c62 to 4f2eca6 Compare June 14, 2023 14:56
@jeffswenson jeffswenson marked this pull request as ready for review June 14, 2023 14:56
@jeffswenson jeffswenson requested a review from a team as a code owner June 14, 2023 14:56
@jeffswenson jeffswenson requested review from a team and ajstorm June 14, 2023 14:57
Copy link
Contributor

@chengxiong-ruan chengxiong-ruan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

awesome test.

@jeffswenson
Copy link
Collaborator Author

bors r+

@jeffswenson
Copy link
Collaborator Author

Thanks for the review!

@craig
Copy link
Contributor

craig bot commented Jun 14, 2023

Build failed (retrying...):

@craig
Copy link
Contributor

craig bot commented Jun 14, 2023

Build succeeded:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-23.1.x Flags PRs that need to be backported to 23.1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Multi Tenant Servers Can Skip Upgrades
3 participants