Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unexpected worker state transition fetch->memory #5169

Closed
crusaderky opened this issue Aug 4, 2021 · 3 comments
Closed

Unexpected worker state transition fetch->memory #5169

crusaderky opened this issue Aug 4, 2021 · 3 comments

Comments

@crusaderky
Copy link
Collaborator

CC @fjetter

A test just randomly failed in CI:
https://github.com/dask/distributed/pull/5166/checks?check_run_id=3239515373

Traceback (most recent call last):
  File "/Users/runner/work/distributed/distributed/distributed/utils.py", line 638, in log_errors
    yield
  File "/Users/runner/work/distributed/distributed/distributed/worker.py", line 2451, in gather_dep
    self.transition(ts, "memory", value=data[d])
  File "/Users/runner/work/distributed/distributed/distributed/worker.py", line 1723, in transition
    func = self._transitions[start, finish]
KeyError: ('fetch', 'memory')
@fjetter
Copy link
Member

fjetter commented Aug 4, 2021

See #5152 and #5157

closing as dup

@fjetter fjetter closed this as completed Aug 4, 2021
@fjetter
Copy link
Member

fjetter commented Aug 4, 2021

test failure should be fixed with #5157 since this will resolve the connected deadlock

@fjetter
Copy link
Member

fjetter commented Aug 4, 2021

I think this is the very first time we were able to connect one of the observed deadlocks to a flaky test. Maybe there is a chance for stable CI after all :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants