Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Execution load balancing #692

Merged
merged 2 commits into from
Mar 10, 2020

Conversation

andreygolev
Copy link
Contributor

serf.Members() seems to usually return same order of nodes.

When we have job definition with tag "label:1", the job is executed usually on the same worker agent .
This PR adds shuffling, before returning a node for execution.

After shuffling is added, we see good load distribution among worker pool with matching tag.

Screenshot 2020-03-05 at 13 44 06

Copy link
Member

@vcastellm vcastellm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM after fixing tests

@andreygolev
Copy link
Contributor Author

tests didn't work by unknown reason

@vcastellm
Copy link
Member

It should work if you rebase master here

missing import added
@andreygolev andreygolev force-pushed the execution_balancing branch from 37d2b65 to 3a94510 Compare March 9, 2020 13:02
@andreygolev
Copy link
Contributor Author

It should work if you rebase master here

Rebase didn't help

@vcastellm
Copy link
Member

Check the tests, it's failing in Test_processFilteredNodes

@andreygolev
Copy link
Contributor Author

There was a bug, indeed. Very bad one :) Now fixed.

@vcastellm
Copy link
Member

There was a bug, indeed. Very bad one :) Now fixed.

Good to have tests then 👍

@vcastellm vcastellm merged commit 5cfd9fc into distribworks:master Mar 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants