Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: Add database level Resource Group/Replica #30040

Open
1 task done
xiaofan-luan opened this issue Jan 16, 2024 · 1 comment
Open
1 task done

[Feature]: Add database level Resource Group/Replica #30040

xiaofan-luan opened this issue Jan 16, 2024 · 1 comment
Assignees
@xiaofan-luan @weiliu1031
Labels
kind/feature Issues related to feature request from users

Comments

@xiaofan-luan
Copy link
Collaborator

Is there an existing issue for this?

  • I have searched the existing issues

Is your feature request related to a problem? Please describe.

Support to add resource group, replica property on a db.

All the collections under the db will load multiple replicas on different resource groups.

usage example :

utility.create_resource_group(name, using='dbGroup1')
utility.create_resource_group(name, using='dbGroup2')

... move some server to resource group
util.alter_db_property("db1", replica = 2, resource group=['dbGroup1', 'dbGroup2'] )

If so, all the collections create in db1 will be loaded with 2 replicas on resource dbGroup1 and dbGroup2, unless user specify explicitly about replicas and resources groups

Describe the solution you'd like.

No response

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response
@xiaofan-luan xiaofan-luan added the kind/feature Issues related to feature request from users label Jan 16, 2024
@xiaofan-luan xiaofan-luan self-assigned this Jan 16, 2024
@xiaofan-luan
Copy link
Collaborator Author

/assign @weiliu1031

please help on this one.

@weiliu1031 weiliu1031 mentioned this issue Mar 19, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue Mar 19, 2024
@weiliu1031
enhance: Enable properites in database meta (#31394)
e6d50de 
issue: #30040

This PR add properties in database meta, so we can store some database
level info.

Signed-off-by: Wei Liu <[email protected]>
@weiliu1031 weiliu1031 mentioned this issue Apr 19, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue Apr 25, 2024
@weiliu1031
enhance: Enable alter database props in rootcoord (#32458)
04f355a 
issue: #30040

---------

Signed-off-by: Wei Liu <[email protected]>
@weiliu1031 weiliu1031 mentioned this issue Apr 26, 2024
Merged
@congqixia congqixia mentioned this issue Apr 26, 2024
Merged
@weiliu1031 weiliu1031 mentioned this issue Apr 28, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue Apr 28, 2024
@weiliu1031
enhance: expose alter database api in proxy (#32639)
07720f1 
issue: #30040

---------

Signed-off-by: Wei Liu <[email protected]>
@weiliu1031 weiliu1031 mentioned this issue Apr 30, 2024
Merged
sre-ci-robot pushed a commit to milvus-io/milvus-sdk-go that referenced this issue May 10, 2024
@weiliu1031
enhance: Add api for describe database and alter database (#741)
9358ff5 
issue: milvus-io/milvus#32707  milvus-io/milvus#30040

Signed-off-by: Wei Liu <[email protected]>
This was referenced May 13, 2024
Merged
Merged
sre-ci-robot pushed a commit to milvus-io/pymilvus that referenced this issue May 13, 2024
@weiliu1031
enhance: Enable set_properties and describe_database api (#2082)
b362af0 
issue: milvus-io/milvus#32707 milvus-io/milvus#30040

Signed-off-by: Wei Liu <[email protected]>
@weiliu1031 weiliu1031 mentioned this issue May 13, 2024
Merged
sre-ci-robot pushed a commit to milvus-io/pymilvus that referenced this issue May 14, 2024
@weiliu1031
enhance: Enable set_properties and describe_database api (#2084)
e8f4a13 
issue: milvus-io/milvus#32707 milvus-io/milvus#30040

Signed-off-by: Wei Liu <[email protected]>
@weiliu1031 weiliu1031 mentioned this issue May 14, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue May 29, 2024
@weiliu1031
enhance: Enable database level replica num and resource groups for lo…
b13932b 
…ading collection (#33052)

issue: #30040

This PR introduce two database level props:
1. database.replica.number
2. database.resource_groups

User can set those two database props by AlterDatabase API, then can
load collection without specified replica_num and resource groups. then
it will use database level load param when try to load collections.

Signed-off-by: Wei Liu <[email protected]>
weiliu1031 added a commit to weiliu1031/milvus that referenced this issue Jun 19, 2024
@weiliu1031
enhance: Enable database level replica num and resource groups for lo…
ec30dcc 
…ading collection (milvus-io#33052)

issue: milvus-io#30040

This PR introduce two database level props:
1. database.replica.number
2. database.resource_groups

User can set those two database props by AlterDatabase API, then can
load collection without specified replica_num and resource groups. then
it will use database level load param when try to load collections.

Signed-off-by: Wei Liu <[email protected]>
@weiliu1031 weiliu1031 mentioned this issue Jun 19, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue Jun 21, 2024
@weiliu1031
enhance: Enable database level replica num and resource groups for lo…
061a00c 
…ading collection (#33052) (#33981)

pr: #33052

issue: #30040

This PR introduce two database level props:
1. database.replica.number
2. database.resource_groups

User can set those two database props by AlterDatabase API, then can
load collection without specified replica_num and resource groups. then
it will use database level load param when try to load collections.

Signed-off-by: Wei Liu <[email protected]>
yellow-shine pushed a commit to yellow-shine/milvus that referenced this issue Jul 2, 2024
@weiliu1031 @yellow-shine
enhance: Enable database level replica num and resource groups for lo…
28c5399 
…ading collection (milvus-io#33052)

issue: milvus-io#30040

This PR introduce two database level props:
1. database.replica.number
2. database.resource_groups

User can set those two database props by AlterDatabase API, then can
load collection without specified replica_num and resource groups. then
it will use database level load param when try to load collections.

Signed-off-by: Wei Liu <[email protected]>
This was referenced Jul 3, 2024
Merged
Merged
Merged
Merged
Merged
@weiliu1031 weiliu1031 mentioned this issue Jul 5, 2024
Merged
sre-ci-robot pushed a commit that referenced this issue Jul 10, 2024
@weiliu1031
enhance: Enable setting the replica number and resource group during …
9b37d3f 
…collection creation (#34403)

issue: #30040

---------

Signed-off-by: Wei Liu <[email protected]>
weiliu1031 added a commit to weiliu1031/milvus that referenced this issue Jul 10, 2024
@weiliu1031
enhance: Enable setting the replica number and resource group during …
ef2fe42 
…collection creation (milvus-io#34403)

issue: milvus-io#30040

---------

Signed-off-by: Wei Liu <[email protected]>
This was referenced Jul 10, 2024
Merged
Merged
sre-ci-robot pushed a commit to milvus-io/pymilvus that referenced this issue Jul 11, 2024
@weiliu1031
enhance: enable setting properties during create database (#2168)
8e0a27b 
issue: milvus-io/milvus#30040

Signed-off-by: Wei Liu <[email protected]>
weiliu1031 added a commit to weiliu1031/pymilvus that referenced this issue Jul 12, 2024
@weiliu1031
enhance: enable setting properties during create database (milvus-io#…
ae9b3b4 
…2168)

issue: milvus-io/milvus#30040

Signed-off-by: Wei Liu <[email protected]>
@weiliu1031 weiliu1031 mentioned this issue Jul 12, 2024
Merged
sre-ci-robot pushed a commit to milvus-io/pymilvus that referenced this issue Jul 15, 2024
@weiliu1031
enhance: enable setting properties during create database (#2168) (#2174
00296ca 
)

issue: milvus-io/milvus#30040
pr: #2168

Signed-off-by: Wei Liu <[email protected]>
sre-ci-robot pushed a commit to milvus-io/milvus-sdk-go that referenced this issue Jul 16, 2024
@weiliu1031
enhance: enable setting properties during create database (#782)
71ec76e 
issue: milvus-io/milvus#30040

Signed-off-by: Wei Liu <[email protected]>
sre-ci-robot pushed a commit that referenced this issue Aug 6, 2024
@weiliu1031
enhance: Enable setting the replica number and resource group during …
2ac1bf7 
…collection creation (#34403) (#34561)

issue: #30040
pr: #34403

---------

Signed-off-by: Wei Liu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@xiaofan-luan xiaofan-luan

@weiliu1031 weiliu1031

Labels
kind/feature Issues related to feature request from users
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@xiaofan-luan @weiliu1031