Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Task pinning to workers #33

Open
gavento opened this issue Apr 12, 2018 · 2 comments
Open

Task pinning to workers #33

gavento opened this issue Apr 12, 2018 · 2 comments
Assignees
Labels
client enhancement New feature or request server

Comments

@gavento
Copy link
Contributor

gavento commented Apr 12, 2018

Add task attribute to allow only a subset of workers. An empty attribute

Usage:

  • Working on files local to a worker (either reading or writing).
    • Useful for open and store tasks (but not limited to them).
  • Selecting suitable worker subset for a taks when (virtual) resources are not appropriate.
    • However, for GPUs and other features, we should use resources.
  • Testing.

Constant data objects already have a similar feature for placement, but this API is not planned to be published (and it is not really relevant for computed data objects).

Alternative: Every worker could be a resource, required by the task. However, this is not ergonomic and we do not have a clear picture of how to do (virtual) resources in the right way.

@gavento
Copy link
Contributor Author

gavento commented Jul 2, 2018

@spirali What is the status of this?

@spirali
Copy link
Collaborator

spirali commented Jul 2, 2018

This is still implemented only for scheduler testing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
client enhancement New feature or request server
Projects
None yet
Development

No branches or pull requests

2 participants