Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: Test 10000 collections and 1000 partitions #37630

Open
14 of 40 tasks
bigsheeper opened this issue Nov 13, 2024 · 3 comments
Open
14 of 40 tasks

[Bug]: Test 10000 collections and 1000 partitions #37630

bigsheeper opened this issue Nov 13, 2024 · 3 comments
Assignees
@bigsheeper
Labels
kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one.

Comments

@bigsheeper
Copy link
Contributor

bigsheeper commented Nov 13, 2024 •
edited
Loading

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version: 2.4.x
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Enhancements and Fixes

Test 1

Test 1

Date: 2024.11.11

Version: 2.4 5c166a2

The main issue: loading is becoming increasingly slower.

11/14/2024 06:57:03 AM - INFO - mcp_empty_263 load in 406.28

image
image
image
image
image
image
Heap:
image
Profile:
image
Goroutine:
image
@bigsheeper bigsheeper added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Nov 13, 2024
@bigsheeper bigsheeper self-assigned this Nov 13, 2024
This was referenced Nov 13, 2024
Closed
Closed
Closed
Closed
congqixia added a commit to congqixia/milvus that referenced this issue Nov 18, 2024
@congqixia
enhance: Provide secondary index crieria when filter leaderview
28caf9c 
Related to milvus-io#37630

Signed-off-by: Congqi Xia <[email protected]>
@congqixia congqixia mentioned this issue Nov 18, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue Nov 19, 2024
@congqixia
enhance: Provide secondary index critria when filter leaderview (#37777)
6d86b90 
Related to #37630

---------

Signed-off-by: Congqi Xia <[email protected]>
congqixia added a commit to congqixia/milvus that referenced this issue Nov 19, 2024
@congqixia
enhance: Remove unnecessary segment clone updating dist
1aa419c 
Related to milvus-io#37630

Signed-off-by: Congqi Xia <[email protected]>
@congqixia congqixia mentioned this issue Nov 19, 2024
Merged
congqixia added a commit to congqixia/milvus that referenced this issue Nov 19, 2024
@congqixia
enhance: Provide secondary index critria when filter leaderview (milv…
f7580df 
…us-io#37777)

Related to milvus-io#37630

---------

Signed-off-by: Congqi Xia <[email protected]>
@congqixia congqixia mentioned this issue Nov 19, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue Nov 20, 2024
@congqixia
enhance: Remove unnecessary segment clone updating dist (#37797)
b8d31eb 
Related to #37630

Signed-off-by: Congqi Xia <[email protected]>
congqixia added a commit to congqixia/milvus that referenced this issue Nov 20, 2024
@congqixia
enhance: Remove unnecessary segment clone updating dist (milvus-io#37797
f62a9c2 
)

Related to milvus-io#37630

Signed-off-by: Congqi Xia <[email protected]>
@congqixia congqixia mentioned this issue Nov 20, 2024
Merged
This was referenced Nov 20, 2024
Merged
Merged
Merged
Closed
Merged
sre-ci-robot pushed a commit that referenced this issue Nov 20, 2024
@congqixia
enhance: [2.4] Remove unnecessary segment clone updating dist (#37797) (
28adfe4 
#37833)

Cherry-pick from master
pr: #37797
Related to #37630

Signed-off-by: Congqi Xia <[email protected]>
@bigsheeper bigsheeper mentioned this issue Nov 20, 2024
Open
sre-ci-robot pushed a commit that referenced this issue Nov 21, 2024
@congqixia
enhance: [2.4] Provide secondary index criteria when filter leaderview (
0bd2617 
#37777) (#37802)

Cherry-pick from master
pr: #37777 
Related to #37630

---------

Signed-off-by: Congqi Xia <[email protected]>
This was referenced Nov 21, 2024
Merged
Merged
Merged
czs007 pushed a commit that referenced this issue Nov 21, 2024
@bigsheeper
enhance: [10kcp] Optimize segmentManager segments (#37884)
9e1ba07 
1. Use vchannel and partition indices for segments.
2. Replace coarse-grained mutex with concurrent map.

issue: #37633,
#37630

pr: #37836

Signed-off-by: bigsheeper <[email protected]>
czs007 pushed a commit that referenced this issue Nov 21, 2024
@bigsheeper
enhance: [10kcp] Accelerate the loading of collection (#37879)
ac7b485 
Remove unnecessary ListIndex and DescribeCollection RPC call during
loading.

issue: #37166,
#37630

pr: #37741

Signed-off-by: bigsheeper <[email protected]>
This was referenced Dec 26, 2024
Open
Merged
czs007 pushed a commit that referenced this issue Dec 27, 2024
@bigsheeper
fix: [10kcp] Fix rootcoord meta mutex contention (#38803)
4d0594b 
RootCoord meta uses copy-on-write, allowing the removal of unnecessary
copies.

issue: #37630

pr: #38799

Signed-off-by: bigsheeper <[email protected]>
This was referenced Dec 27, 2024
Open
Merged
czs007 pushed a commit that referenced this issue Dec 27, 2024
@bigsheeper
fix: [10kcp] Fix incorrect memory estimation for small segments (#38814)
fee1f77 
Skip estimation index memory logic for segments without index file.

issue: #37630

pr: #38813

Signed-off-by: bigsheeper <[email protected]>
This was referenced Dec 27, 2024
Open
Closed
Merged
czs007 pushed a commit that referenced this issue Dec 27, 2024
@bigsheeper
enhance: [10kcp] Prevent frequently updating metric (#38828)
c25fdf8 
issue: #37630

pr: #38827

Signed-off-by: bigsheeper <[email protected]>
This was referenced Jan 1, 2025
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
Merged
czs007 pushed a commit that referenced this issue Jan 2, 2025
@bigsheeper
enhance: [10kcp] Add logs for querycoord checker (#38953)
734a20a 
issue: #37630

Signed-off-by: bigsheeper <[email protected]>
@bigsheeper bigsheeper mentioned this issue Jan 3, 2025
Merged
czs007 pushed a commit that referenced this issue Jan 3, 2025
@bigsheeper @weiliu1031
fix: [10kcp] channel unbalance during stopping balance progress (#38972)
f5f4fed 
issue: #38970,
#37630

cause the stopping balance channel still use the row_count_based policy,
which may causes channel unbalance in multi-collection case.

This PR impl a score based stopping balance channel policy.

pr: #38971

Signed-off-by: bigsheeper <[email protected]>
Co-authored-by: Wei Liu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bigsheeper bigsheeper

Labels
kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@bigsheeper @xiaofan-luan