-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Filter by keyspace earlier in tabletgateway
s WaitForTablets(...)
#15347
Filter by keyspace earlier in tabletgateway
s WaitForTablets(...)
#15347
Conversation
Signed-off-by: Tim Vaillancourt <[email protected]>
Review ChecklistHello reviewers! 👋 Please follow this checklist when reviewing this Pull Request. General
Tests
Documentation
New flags
If a workflow is added or modified:
Backward compatibility
|
Signed-off-by: Tim Vaillancourt <[email protected]>
Signed-off-by: Tim Vaillancourt <[email protected]>
Signed-off-by: Tim Vaillancourt <[email protected]>
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #15347 +/- ##
==========================================
+ Coverage 65.39% 65.43% +0.03%
==========================================
Files 1561 1561
Lines 193524 193630 +106
==========================================
+ Hits 126563 126696 +133
+ Misses 66961 66934 -27 ☔ View full report in Codecov by Sentry. |
Signed-off-by: Tim Vaillancourt <[email protected]>
Signed-off-by: Tim Vaillancourt <[email protected]>
Signed-off-by: Tim Vaillancourt <[email protected]>
Signed-off-by: Tim Vaillancourt <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! I only had a few very minor comments/nits. Let me know what you think and I can come back to this quickly and help to get it merged.
Thanks, @timvaillancourt !
@timvaillancourt do you mind creating a real quick issue as well for this? 🙏 |
Signed-off-by: Tim Vaillancourt <[email protected]>
Signed-off-by: Tim Vaillancourt <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks, @timvaillancourt ! ❤️
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice work! I'm loving these little optimizations that y'all have been doing.
…itessio#15347) Signed-off-by: Tim Vaillancourt <[email protected]>
…itessio#15347) Signed-off-by: Tim Vaillancourt <[email protected]>
…itessio#15347) (#229) Signed-off-by: Tim Vaillancourt <[email protected]>
…izations (#227) * Load `--grpc_auth_static_client_creds` file once (vitessio#15030) Signed-off-by: Tim Vaillancourt <[email protected]> * Filter by keyspace earlier in `tabletgateway`s `WaitForTablets(...)` (vitessio#15347) Signed-off-by: Tim Vaillancourt <[email protected]> * Limit concurrent creation of healthcheck gRPC connections (vitessio#15053) Signed-off-by: Tim Vaillancourt <[email protected]> * go mod tidy Signed-off-by: Tim Vaillancourt <[email protected]> * Update MySQL apt package and GPG signature (vitessio#14785) Signed-off-by: Matt Lord <[email protected]> * remove unrelated workflow files from v20 Signed-off-by: Tim Vaillancourt <[email protected]> --------- Signed-off-by: Tim Vaillancourt <[email protected]> Signed-off-by: Matt Lord <[email protected]> Co-authored-by: Matt Lord <[email protected]>
…itessio#15347) Signed-off-by: Tim Vaillancourt <[email protected]>
* Make `Durabler` interface methods public (vitessio#15548) Signed-off-by: Tim Vaillancourt <[email protected]> Signed-off-by: Manan Gupta <[email protected]> Co-authored-by: Manan Gupta <[email protected]> * Load `--grpc_auth_static_client_creds` file once (vitessio#15030) Signed-off-by: Tim Vaillancourt <[email protected]> * Limit concurrent creation of healthcheck gRPC connections (vitessio#15053) Signed-off-by: Tim Vaillancourt <[email protected]> * Filter by keyspace earlier in `tabletgateway`s `WaitForTablets(...)` (vitessio#15347) Signed-off-by: Tim Vaillancourt <[email protected]> * Use slack-15.0 as previous release Signed-off-by: Tim Vaillancourt <[email protected]> * empty commit Signed-off-by: Tim Vaillancourt <[email protected]> * force ci to run * Update GH Action runners Signed-off-by: Tim Vaillancourt <[email protected]> * test templates Signed-off-by: Tim Vaillancourt <[email protected]> * set GH access token in build Signed-off-by: Tim Vaillancourt <[email protected]> * Fix reparent old tests Signed-off-by: Tim Vaillancourt <[email protected]> * Remove CIs we don't need Signed-off-by: Tim Vaillancourt <[email protected]> * Remove CIs we don't need again Signed-off-by: Tim Vaillancourt <[email protected]> * Add private repo setup to upgrade_downgrade_test_backups_e2e.yml Signed-off-by: Tim Vaillancourt <[email protected]> * Add private repo setup to more CI Signed-off-by: Tim Vaillancourt <[email protected]> * remove CI skip logic for upstream stuff Signed-off-by: Tim Vaillancourt <[email protected]> * CODEOWNERS Signed-off-by: Tim Vaillancourt <[email protected]> * [release-19.0] Add timeout to all the contexts used for RPC calls in vtorc (vitessio#15991) (vitessio#16103) Signed-off-by: Manan Gupta <[email protected]> * `slack-vitess-r15.0.5`: forward-port consul topo limits PR #111 (#297) * `slack-vitess-r14.0.5`: allow conn overrides in consul topo (#111) * `slack-vitess-r14.0.5`: allow conn overrides in consul topo Signed-off-by: Tim Vaillancourt <[email protected]> * fix e2e test Signed-off-by: Tim Vaillancourt <[email protected]> --------- Signed-off-by: Tim Vaillancourt <[email protected]> * Update flags tests that didn't exist in v14 Signed-off-by: Tim Vaillancourt <[email protected]> --------- Signed-off-by: Tim Vaillancourt <[email protected]> * update vtcombo e2e Signed-off-by: Tim Vaillancourt <[email protected]> * Fix err with installing percona-xtrabackup-24 Signed-off-by: Tim Vaillancourt <[email protected]> * `slack-vitess-r15.0.5`: fix races in `Unit Test (Race)` CI, fix "old" reparent CIs (#356) * update vtcombo e2e test Signed-off-by: Tim Vaillancourt <[email protected]> * Fix bad merge conflict fix Signed-off-by: Tim Vaillancourt <[email protected]> * go mod tidy Signed-off-by: Tim Vaillancourt <[email protected]> * update vtcombo e2e test again Signed-off-by: Tim Vaillancourt <[email protected]> * [release-19.0] Upgrade the Golang version to `go1.22.5` (vitessio#16322) Signed-off-by: GitHub <[email protected]> Signed-off-by: Florent Poinsard <[email protected]> Co-authored-by: frouioui <[email protected]> Co-authored-by: Florent Poinsard <[email protected]> * merge conflict fixes Signed-off-by: Tim Vaillancourt <[email protected]> * make vtadmin_web_proto_types Signed-off-by: Tim Vaillancourt <[email protected]> --------- Signed-off-by: Tim Vaillancourt <[email protected]> Signed-off-by: Manan Gupta <[email protected]> Signed-off-by: GitHub <[email protected]> Signed-off-by: Florent Poinsard <[email protected]> Co-authored-by: Manan Gupta <[email protected]> Co-authored-by: Manan Gupta <[email protected]> Co-authored-by: vitess-bot <[email protected]> Co-authored-by: frouioui <[email protected]> Co-authored-by: Florent Poinsard <[email protected]>
…itessio#15347) Signed-off-by: Tim Vaillancourt <[email protected]>
…itessio#15347) Signed-off-by: Tim Vaillancourt <[email protected]>
Description
This PR causes the
tabletgateway
.WaitForTablets(...)
method to filter targets by keyspace (set by--keyspaces_to_watch
) earlier in the processCurrently, the logic under
.WaitForTablets(...)
:srvtopo.FindAllTargets(...)
to fetch the targets by-cell for any keyspace (even if--keyspaces_to_watch
is set).GetSrvKeyspace(...)
on the toposerver for every keyspace in goroutines w/wait group--keyspaces_to_watch
are removed fromtargets []*querypb.Target
Instead this PR implements the filtering in
srvtopo.FindAllTargets(...)
by not-fetching keyspaces from the topo that will just get filtered anyways. This can avoid topo calls and unnecessary filtering of results on deployments with many keyspaces and a subset of keyspaces set as--keyspaces_to_watch
The changed codepath and signatures are only called by
vtgate
/tabletgateway
so this change had a limited impactRelated Issue(s)
tabletgateway
'sWaitForTablets(...)
#15373Checklist