Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

changefeedccl: ensure show changefeed jobs does not impact foreground latency #101502

Closed
amruss opened this issue Apr 13, 2023 · 2 comments
Closed

changefeedccl: ensure show changefeed jobs does not impact foreground latency #101502

amruss opened this issue Apr 13, 2023 · 2 comments
Labels
A-cdc Change Data Capture C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) T-cdc

Comments

@amruss
Copy link
Contributor

amruss commented Apr 13, 2023 •
edited by exalate-issue-sync bot
Loading

Follow up to cdc pre mortem: https://docs.google.com/document/d/1X2D64G_Jdb9S4MxrBYPH_fwKAP3dkUrhc7yUgZZNZAY/edit#

We're worried that running show changefeed jobs here impacting foreground latency for big customers (who may have thousands of jobs/changefeed jobs). We should probably have a virtual index on SHOW JOBS so we don’t have to scan all jobs. A quick win would be probably the virtual index on job type and created/updated time.

Jira issue: CRDB-26975

Epic CRDB-9398
@amruss amruss added the C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) label Apr 13, 2023
@blathers-crl
Copy link

blathers-crl bot commented Apr 13, 2023

cc @cockroachdb/cdc

@blathers-crl blathers-crl bot added the A-cdc Change Data Capture label Apr 13, 2023
@amruss
Copy link
Contributor Author

amruss commented Apr 26, 2023

Closing this with the rewrite of the jobs system

@amruss amruss closed this as completed Apr 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-cdc Change Data Capture C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) T-cdc
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@amruss