Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add fail_hard decorator for worker methods #6210

Merged
merged 18 commits into from
Apr 29, 2022
Merged

Add fail_hard decorator for worker methods #6210

merged 18 commits into from
Apr 29, 2022

Commits on Apr 26, 2022

  1. Add fail_hard decorator for worker methods 

    We add a decorator that we can apply to a worker method that closes the
worker if an exception is encountered in that method.

This is still a work in progress, and is just up here as a proof of
concept.
    @mrocklin
    mrocklin committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    6cbc05e View commit details
    Browse the repository at this point in the history

  2. Add test and scheduler eventing for fail_hard

    @mrocklin
    mrocklin committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    6eeac6b View commit details
    Browse the repository at this point in the history

  3. Fail hard on worker handlers

    @mrocklin
    mrocklin committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    97511ed View commit details
    Browse the repository at this point in the history

  4. Only fail_hard on handlers and gather_dep

    @mrocklin
    mrocklin committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    73471b2 View commit details
    Browse the repository at this point in the history

  5. remove fail_hard on sync handlers

    @mrocklin
    mrocklin committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    b2fa15b View commit details
    Browse the repository at this point in the history

  6. Disallow non-coroutinefunctions

    @mrocklin
    mrocklin committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    a991d84 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2022

  1. Merge branch 'main' of github.com:dask/distributed into fail-hard

    @mrocklin
    mrocklin committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    b33b411 View commit details
    Browse the repository at this point in the history

  2. Use new fail_hard on more methods 

    Also set the chaos_rechunk test to sys.exit,
this to focus us on situations where another worker fails,
rather than this worker.
    @mrocklin
    mrocklin committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    43b2962 View commit details
    Browse the repository at this point in the history

  3. remove exception handling from handle_scheduler

    @mrocklin
    mrocklin committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    a0721aa View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2022

  1. Remove test_reconnect 

    We've removed this functionality for now
    @mrocklin
    mrocklin committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    b59ccd0 View commit details
    Browse the repository at this point in the history

  2. Remove other test_reconnect

    @mrocklin
    mrocklin committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    a08b5dd View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of github.com:dask/distributed into fail-hard

    @mrocklin
    mrocklin committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    e1c7447 View commit details
    Browse the repository at this point in the history

  4. remove test_no_reconnect too

    @mrocklin
    mrocklin committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    a0b6f10 View commit details
    Browse the repository at this point in the history

  5. Revert "remove exception handling from handle_scheduler" 

    This reverts commit a0721aa.
    @mrocklin
    mrocklin committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    ebe8886 View commit details
    Browse the repository at this point in the history

  6. Revert "Remove test_reconnect" 

    This reverts commit b59ccd0.
    @mrocklin
    mrocklin committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    a1399a1 View commit details
    Browse the repository at this point in the history

  7. Revert "Remove other test_reconnect" 

    This reverts commit a08b5dd.
    @mrocklin
    mrocklin committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    0505df8 View commit details
    Browse the repository at this point in the history

  8. Remove exception block from handle_scheduler

    @mrocklin
    mrocklin committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    50c31ef View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2022

  1. [skip ci] remove comment

    @mrocklin
    mrocklin committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    96f7bd2 View commit details
    Browse the repository at this point in the history