Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enhance: remove the rpc layer of coordinator when enabling standalone or mixcoord #37815

Merged

Conversation

chyezh
Copy link
Contributor

@chyezh chyezh commented Nov 19, 2024

issue: #37764

  • add a local client to call local server directly for querycoord/rootcoord/datacoord.
  • enable local client if milvus is running mixcoord or standalone mode.

@sre-ci-robot sre-ci-robot added the size/XXL Denotes a PR that changes 1000+ lines. label Nov 19, 2024
@mergify mergify bot added dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement labels Nov 19, 2024
Copy link
Contributor

mergify bot commented Nov 19, 2024

@chyezh E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

Copy link

codecov bot commented Nov 19, 2024

Codecov Report

Attention: Patch coverage is 85.60000% with 18 lines in your changes missing coverage. Please review.

Project coverage is 81.03%. Comparing base (3cb9511) to head (d9b81d4).
Report is 24 commits behind head on master.

Files with missing lines Patch % Lines
internal/util/grpcclient/local_grpc_client.go 72.72% 7 Missing and 2 partials ⚠️
internal/coordinator/coordclient/registry.go 92.00% 3 Missing and 3 partials ⚠️
pkg/util/syncutil/future.go 57.14% 3 Missing ⚠️
Additional details and impacted files

Impacted file tree graph

@@           Coverage Diff            @@
##           master   #37815    +/-   ##
========================================
  Coverage   81.02%   81.03%            
========================================
  Files        1357     1360     +3     
  Lines      190195   190664   +469     
========================================
+ Hits       154113   154501   +388     
- Misses      30601    30671    +70     
- Partials     5481     5492    +11     
Components Coverage Δ
Client 72.16% <ø> (ø)
Core 68.87% <ø> (ø)
Go 83.20% <85.60%> (-0.01%) ⬇️
Files with missing lines Coverage Δ
internal/datacoord/server.go 72.98% <100.00%> (-0.57%) ⬇️
internal/distributed/datacoord/service.go 90.47% <100.00%> (+1.13%) ⬆️
internal/distributed/querycoord/service.go 79.18% <100.00%> (+1.97%) ⬆️
internal/distributed/rootcoord/service.go 80.66% <100.00%> (+0.86%) ⬆️
pkg/util/syncutil/future.go 88.00% <57.14%> (-12.00%) ⬇️
internal/coordinator/coordclient/registry.go 92.00% <92.00%> (ø)
internal/util/grpcclient/local_grpc_client.go 72.72% <72.72%> (ø)

... and 55 files with indirect coverage changes

---- 🚨 Try these New Features:

@chyezh chyezh changed the title enhance: remove the rpc level of coordinator when enabling standalone or mixcoord enhance: remove the rpc layer of coordinator when enabling standalone or mixcoord Nov 19, 2024
@chyezh chyezh force-pushed the enhance_merge_all_coord_into_one branch 2 times, most recently from d10f396 to cec8f21 Compare November 19, 2024 13:25
Copy link
Contributor

mergify bot commented Nov 19, 2024

@chyezh go-sdk check failed, comment rerun go-sdk can trigger the job again.

@chyezh chyezh force-pushed the enhance_merge_all_coord_into_one branch 2 times, most recently from a7daaae to 7cb3836 Compare November 20, 2024 11:19
Copy link
Contributor

mergify bot commented Nov 20, 2024

@chyezh E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

@chyezh chyezh force-pushed the enhance_merge_all_coord_into_one branch 2 times, most recently from b13e4d3 to 44831eb Compare November 21, 2024 07:26
@sre-ci-robot sre-ci-robot added area/dependency Pull requests that update a dependency file size/L Denotes a PR that changes 100-499 lines. and removed size/XXL Denotes a PR that changes 1000+ lines. labels Nov 21, 2024
@chyezh chyezh force-pushed the enhance_merge_all_coord_into_one branch from 44831eb to e495cbf Compare November 21, 2024 12:25
Copy link
Contributor

mergify bot commented Nov 21, 2024

@chyezh go-sdk check failed, comment rerun go-sdk can trigger the job again.

@chyezh
Copy link
Contributor Author

chyezh commented Nov 22, 2024

rerun go-sdk

@mergify mergify bot added ci-passed and removed ci-passed labels Nov 22, 2024
Signed-off-by: chyezh <[email protected]>
@chyezh chyezh force-pushed the enhance_merge_all_coord_into_one branch from 4584c90 to d9b81d4 Compare November 22, 2024 09:08
@mergify mergify bot added the ci-passed label Nov 22, 2024
@jaime0815
Copy link
Contributor

/lgtm

@sre-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

Approval requirements bypassed by manually added approval.

This pull-request has been approved by: chyezh

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@sre-ci-robot sre-ci-robot merged commit b9a10a2 into milvus-io:master Nov 23, 2024
19 of 20 checks passed
@chyezh chyezh deleted the enhance_merge_all_coord_into_one branch November 24, 2024 03:30
sre-ci-robot pushed a commit that referenced this pull request Nov 25, 2024
… or mixcoord (#37959)

issue: #37764
pr: #37815

- add a local client to call local server directly for
querycoord/rootcoord/datacoord.
- enable local client if milvus is running mixcoord or standalone mode.

---------

Signed-off-by: chyezh <[email protected]>
JsDove pushed a commit to JsDove/milvus that referenced this pull request Nov 26, 2024
… or mixcoord (milvus-io#37815)

issue: milvus-io#37764

- add a local client to call local server directly for
querycoord/rootcoord/datacoord.
- enable local client if milvus is running mixcoord or standalone mode.

---------

Signed-off-by: chyezh <[email protected]>
czs007 pushed a commit that referenced this pull request Dec 5, 2024
… or mixcoord (#38246)

issue: #33285
pr: #37815

- remove the rpc layer of coordinator when enabling standalone or
mixcoord
- move health check into init

---------

Signed-off-by: chyezh <[email protected]>
sre-ci-robot pushed a commit that referenced this pull request Dec 10, 2024
… or mixcoord (#38207)

issue: #37764
pr: #37815 
also see: #38259

- add a local client to call local server directly for
querycoord/rootcoord/datacoord.
- enable local client if milvus is running mixcoord or standalone mode.
- after removing rpc layer from mixcoord, the querycoord at standby mode
will be blocked forever of deployment rolling

---------

Signed-off-by: chyezh <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved area/dependency Pull requests that update a dependency file ci-passed dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement lgtm size/L Denotes a PR that changes 100-499 lines.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants