Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Enhancement]: scalar memory optimization #33533

Closed
1 task done
zhagnlu opened this issue Jun 1, 2024 · 1 comment
Closed
1 task done

[Enhancement]: scalar memory optimization #33533

zhagnlu opened this issue Jun 1, 2024 · 1 comment
Labels
kind/enhancement Issues or changes related to enhancement stale indicates no udpates for 30 days

Comments

@zhagnlu
Copy link
Contributor

zhagnlu commented Jun 1, 2024

Is there an existing issue for this?

  • I have searched the existing issues

What would you like to be added?

currently, memory usage for scalar type loading is unexpected. Mainly because of usage of internal object just like some cache, Focusing on cache usage to optimize it.

Why is this needed?

No response

Anything else?

No response
@zhagnlu zhagnlu added the kind/enhancement Issues or changes related to enhancement label Jun 1, 2024
This was referenced Jun 1, 2024
Merged
Merged
sre-ci-robot pushed a commit that referenced this issue Jun 4, 2024
@zhagnlu
enhance: optimize some cache to reduce memory usage (#33534)
c6f8a73 
#33533

Signed-off-by: luzhang <[email protected]>
Co-authored-by: luzhang <[email protected]>
@zhagnlu zhagnlu mentioned this issue Jun 4, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue Jun 5, 2024
@zhagnlu
fix: fix load failure (#33599)
8ad2609 
issue: #33533

Signed-off-by: luzhang <[email protected]>
Co-authored-by: luzhang <[email protected]>
@zhagnlu zhagnlu mentioned this issue Jun 6, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue Jun 7, 2024
@zhagnlu
fix: clean vector memory (#33692)
6ce9df9 
#33533

Signed-off-by: luzhang <[email protected]>
Co-authored-by: luzhang <[email protected]>
zhagnlu added a commit to zhagnlu/milvus that referenced this issue Jun 7, 2024
@zhagnlu
fix: clean vector memory (milvus-io#33692)
d80d1c1 
milvus-io#33533

Signed-off-by: luzhang <[email protected]>
Co-authored-by: luzhang <[email protected]>
@zhagnlu zhagnlu mentioned this issue Jun 14, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue Jun 16, 2024
@zhagnlu
fix: readd timestamp index because segment timestamp not ordered (#33856
e422168 
)

#33533

Signed-off-by: luzhang <[email protected]>
Co-authored-by: luzhang <[email protected]>
yellow-shine pushed a commit to yellow-shine/milvus that referenced this issue Jul 2, 2024
@zhagnlu @yellow-shine
enhance: optimize some cache to reduce memory usage (milvus-io#33534)
9c66f67 
milvus-io#33533

Signed-off-by: luzhang <[email protected]>
Co-authored-by: luzhang <[email protected]>
yellow-shine pushed a commit to yellow-shine/milvus that referenced this issue Jul 2, 2024
@zhagnlu @yellow-shine
fix: fix load failure (milvus-io#33599)
42d8913 
issue: milvus-io#33533

Signed-off-by: luzhang <[email protected]>
Co-authored-by: luzhang <[email protected]>
yellow-shine pushed a commit to yellow-shine/milvus that referenced this issue Jul 2, 2024
@zhagnlu @yellow-shine
fix: clean vector memory (milvus-io#33692)
127592f 
milvus-io#33533

Signed-off-by: luzhang <[email protected]>
Co-authored-by: luzhang <[email protected]>
yellow-shine pushed a commit to yellow-shine/milvus that referenced this issue Jul 2, 2024
@zhagnlu @yellow-shine
fix: readd timestamp index because segment timestamp not ordered (mil…
bcdc60b 
…vus-io#33856)

milvus-io#33533

Signed-off-by: luzhang <[email protected]>
Co-authored-by: luzhang <[email protected]>
@stale Stale
Copy link

stale bot commented Jul 3, 2024

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

@stale stale bot added the stale indicates no udpates for 30 days label Jul 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/enhancement Issues or changes related to enhancement stale indicates no udpates for 30 days
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@zhagnlu @xiaofan-luan