Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: add kv/splits/nodes=3/quiesce=false/lease=leader #133216

Merged

Conversation

nvanbenschoten
Copy link
Member

@nvanbenschoten nvanbenschoten commented Oct 23, 2024

Part of #132762.

This commit adds a kv/splits/nodes=3/quiesce=false/lease=leader test. It should be able to support 80k ranges even without quiescence, because leader leases use store liveness for failure detection and lease extension.

To push higher than this, we will likely need to address #133885.

Release note: None

@nvanbenschoten nvanbenschoten added the backport-24.3.x Flags PRs that need to be backported to 24.3 label Oct 23, 2024
@nvanbenschoten nvanbenschoten requested a review from a team as a code owner October 23, 2024 03:07
@nvanbenschoten nvanbenschoten requested review from herkolategan and vidit-bhat and removed request for a team October 23, 2024 03:07
@cockroach-teamcity
Copy link
Member

This change is Reviewable

@nvanbenschoten
Copy link
Member Author

We max out all 4 cpus on each node at about 100k ranges, so we'll need to do more work before we can push up to 300k ranges. One thing I see in profiles is a large, growing number of MsgDeFortifyLeaders — we'll benefit from #132616, once that lands.

@nvanbenschoten nvanbenschoten force-pushed the nvanbenschoten/splitsTestLeaderLease branch 2 times, most recently from 3abf9d1 to da7d126 Compare October 30, 2024 23:47
@nvanbenschoten nvanbenschoten force-pushed the nvanbenschoten/splitsTestLeaderLease branch from da7d126 to fe1c554 Compare November 7, 2024 15:23
This commit adds a `kv/splits/nodes=3/quiesce=false/lease=leader` test. It
should be able to support 80k ranges even without quiescence, because leader
leases use store liveness for failure detection and lease extension.

To push higher than this, we will likely need to address cockroachdb#133885.

Epic: None
Release note: None
@nvanbenschoten nvanbenschoten force-pushed the nvanbenschoten/splitsTestLeaderLease branch from c5214cb to 348352b Compare November 12, 2024 19:02
Copy link
Contributor

@iskettaneh iskettaneh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 4 of 4 files at r1.
Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @herkolategan and @vidit-bhat)

Copy link
Contributor

@iskettaneh iskettaneh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 3 of 3 files at r4, all commit messages.
Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @herkolategan and @vidit-bhat)

@nvanbenschoten
Copy link
Member Author

TFTR!

bors r+

@craig craig bot merged commit c1a452d into cockroachdb:master Nov 12, 2024
23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-24.3.x Flags PRs that need to be backported to 24.3
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants