Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve resource assignment for comp. services #3093

Closed
mguidon opened this issue Jun 9, 2022 · 1 comment
Closed

Improve resource assignment for comp. services #3093

mguidon opened this issue Jun 9, 2022 · 1 comment
Assignees
Labels
a:dask-service Any of the dask services: dask-scheduler/sidecar or worker

Comments

@mguidon
Copy link
Member

mguidon commented Jun 9, 2022

We need a concept for:

  • serial (1 core)
  • multithreaded (M cores)
  • MPI (N cores)
  • MPI-multithreaded (N cores x M cores)
  • GPU accelerated (C cards x M cores)

I suggest to do this using two settings on the service labels

Runtype:

One of: [serial, MPI, GPU accelerated]

Resources

any combination of:

threads: number of cores
ranks: number of MPI process
gpus: number of GPUs to use

If nothing defined on service-labels, defaults to 1 core non threaded, non MPI non GPU. Otherwise, reasonable defaults are provided.

@sanderegg
Copy link
Member

this is outdated. resources can be applied. if this is still needed, please upgrade the case or create a new one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
a:dask-service Any of the dask services: dask-scheduler/sidecar or worker
Projects
None yet
Development

No branches or pull requests

3 participants