Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restores of many incremental layers is slow #98766

Closed
rhu713 opened this issue Mar 16, 2023 · 1 comment
Closed

Restores of many incremental layers is slow #98766

rhu713 opened this issue Mar 16, 2023 · 1 comment
Labels
A-disaster-recovery C-investigation Further steps needed to qualify. C-label will change. T-disaster-recovery

Comments

@rhu713
Copy link
Contributor

rhu713 commented Mar 16, 2023

Describe the problem
The issue was brought to our attention via a failure of the 400GB/48-inc roachtest due to a timeout: #98437

The restore in this test seems to run slower than a test of the same size with 12 incremental layers.

I have some suspicion that openSSTs in restore data processor becomes a bottleneck as the number of incremental layers increase, but further investigation is needed into why restores with more incremental layers is slow.

Jira issue: CRDB-25509

Epic CRDB-20916

@rhu713 rhu713 added C-investigation Further steps needed to qualify. C-label will change. A-disaster-recovery T-disaster-recovery labels Mar 16, 2023
@blathers-crl
Copy link

blathers-crl bot commented Mar 16, 2023

cc @cockroachdb/disaster-recovery

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-disaster-recovery C-investigation Further steps needed to qualify. C-label will change. T-disaster-recovery
Projects
No open projects
Archived in project
Development

No branches or pull requests

3 participants