-
Notifications
You must be signed in to change notification settings - Fork 3.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
sql/rowexec: subject column backfills to admission control #79115
sql/rowexec: subject column backfills to admission control #79115
Conversation
I see that backups use |
|
This patch adds the functions `DB.TxnWithAdmissionControl()` and `kv.NewTxnWithAdmissionControl()`, which allow the caller to set the admission control source and priority. The default variants of these functions use source `OTHER` which bypasses admission control. Release note: None
This patch subjects column backfills to admission control, using normal priority. Release note (bug fix): `ALTER TABLE [ADD|DROP] COLUMN` are now subject to admission control, which will prevent these operations from overloading the storage engine.
7191c20
to
1f47599
Compare
Cool, thanks. I want to backport this, and 21.2 only has low/normal/high priorities, so we may want to keep the normal priority just to be conservative. But yeah, we should move all of these bulk jobs over to a lower priority from 22.1 onwards. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewed 3 of 3 files at r1, 2 of 2 files at r2, all commit messages.
Reviewable status: complete! 1 of 0 LGTMs obtained (waiting on @dt and @sumeerbhola)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewed 1 of 2 files at r2.
Reviewable status: complete! 2 of 0 LGTMs obtained (waiting on @dt)
more of a general comment for the future: it seems like it would be quite beneficial if we had a way to assert/test that admission control was in effect. (i had the same desire for verifying that the TTL job was using admission control) |
TFTRs! bors r=ajwerner,sumeerbhola
Yeah, we need a more comprehensive approach to admission control for internal traffic. I'll write up an issue for this, including testing aspects. EDIT: #79212. |
Build succeeded: |
Encountered an error creating backports. Some common things that can go wrong:
You might need to create your backport manually using the backport tool. error creating merge commit from 1d4a1a3 to blathers/backport-release-21.2-79115: POST https://api.github.com/repos/cockroachdb/cockroach/merges: 409 Merge conflict [] you may need to manually resolve merge conflicts with the backport tool. Backport to branch 21.2.x failed. See errors above. 🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is otan. |
kv: add txn helpers that configure admission control
This patch adds the functions
DB.TxnWithAdmissionControl()
andkv.NewTxnWithAdmissionControl()
, which allow the caller to set theadmission control source and priority. The default variants of these
functions use source
OTHER
which bypasses admission control.Release note: None
sql/rowexec: subject column backfills to admission control
This patch subjects column backfills to admission control, using normal
priority.
Release note (bug fix):
ALTER TABLE [ADD|DROP] COLUMN
are now subjectto admission control, which will prevent these operations from
overloading the storage engine.