Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kvserver: smear size based range splits #125929

Open
kvoli opened this issue Jun 20, 2024 · 1 comment
Open

kvserver: smear size based range splits #125929

kvoli opened this issue Jun 20, 2024 · 1 comment
Labels
A-kv-distribution Relating to rebalancing and leasing. C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) O-testcluster Issues found or occurred on a test cluster, i.e. a long-running internal cluster P-3 Issues/test failures with no fix SLA T-kv KV Team

Comments

@kvoli
Copy link
Collaborator

kvoli commented Jun 20, 2024

When running a uniform write workload, on a uniformly sized keyspace, ranges will split in half at approximately the same time.

Normally, when a few ranges split this isn't expected to have any impact as #22348 removes the latch contention latency. However, scanning the range data simultaneously for many splits can cause CPU exhaustion, which does result in higher tail latency.

image
image

This issue is to smear, or space out size-based range splits so that they do not all occur at the same time for uniform workloads.

Jira issue: CRDB-39670

Epic CRDB-39952

@kvoli kvoli added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. A-kv-distribution Relating to rebalancing and leasing. T-kv KV Team labels Jun 20, 2024
Copy link

blathers-crl bot commented Jun 20, 2024

Hi @kvoli, please add branch-* labels to identify which branch(es) this C-bug affects.

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

@kvoli kvoli added C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) and removed C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. labels Jun 20, 2024
@ajstorm ajstorm added O-testcluster Issues found or occurred on a test cluster, i.e. a long-running internal cluster P-3 Issues/test failures with no fix SLA labels Jun 20, 2024
@github-project-automation github-project-automation bot moved this to Incoming in KV Aug 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-kv-distribution Relating to rebalancing and leasing. C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) O-testcluster Issues found or occurred on a test cluster, i.e. a long-running internal cluster P-3 Issues/test failures with no fix SLA T-kv KV Team
Projects
No open projects
Status: Incoming
Development

No branches or pull requests

2 participants