Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhancement: Lock a EC2 machine for a specific project #5669

Open
Tracked by #1339 ...
sanderegg opened this issue Apr 12, 2024 · 2 comments
Open
Tracked by #1339 ...

Enhancement: Lock a EC2 machine for a specific project #5669

sanderegg opened this issue Apr 12, 2024 · 2 comments
Assignees
Labels
a:autoscaling autoscaling service in simcore's stack a:director-v2 issue related with the director-v2 service a:webserver issue related to the webserver service

Comments

@sanderegg
Copy link
Member

sanderegg commented Apr 12, 2024

As a user of TIP where the osparc App mode is in use it would be more cost efficient and fast to keep a specific EC2 up for the duration a project is opened.

The idea would be to do the following to reserve a machine for a set of services with using the project uuid as a resource:

  • modify dynamic scheduler to create a docker service using the project uuid as a placement constraint,
  • autoscaling would recognize that specific placement constraint, start a machine, and once the machine is up add the specific label on the node,
  • automatically all the services with that node constraint would then go to that specific machine,
  • if more than one machine is needed, this should actually not prevent the autoscaler from creating more of them,
  • if we want later to share the a machine data, then we would also need to make the autoscaling app wait a bit before creating a new one (until the current service is shutdown and leaves space for the next one),

Option:

  • do not require shutdown of previous service by having service reservations low (since they do not run in parallel - this would need to be somehow guaranteed...)
@sanderegg sanderegg transferred this issue from ITISFoundation/osparc-issues Apr 12, 2024
@sanderegg sanderegg self-assigned this May 23, 2024
@sanderegg sanderegg added a:director-v2 issue related with the director-v2 service a:autoscaling autoscaling service in simcore's stack labels May 23, 2024
@sanderegg sanderegg added this to the Leeroy Jenkins milestone May 23, 2024
@sanderegg sanderegg added the a:webserver issue related to the webserver service label May 23, 2024
@sanderegg sanderegg removed this from the South Island Iced Tea milestone Jul 8, 2024
@mrnicegyu11 mrnicegyu11 changed the title Lock a EC2 machine for a specific project Enhancement: Lock a EC2 machine for a specific project Aug 19, 2024
@mguidon
Copy link
Member

mguidon commented Nov 25, 2024

This just came up in another discussion and we most likely want to implement it

@matusdrobuliak66
Copy link
Contributor

matusdrobuliak66 commented Nov 25, 2024

We should write implementation notes that consider the big picture of providing users with the option (including via the UI) to set up their own computers with multiple services, as well as the potential consequences for the current UI.

Questions:

  • what about pipeline view?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
a:autoscaling autoscaling service in simcore's stack a:director-v2 issue related with the director-v2 service a:webserver issue related to the webserver service
Projects
None yet
Development

No branches or pull requests

3 participants