Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding Dask support to mrun #927

Draft
wants to merge 17 commits into
base: main
Choose a base branch
from
Draft

Adding Dask support to mrun #927

wants to merge 17 commits into from

Commits on Feb 27, 2024

  1. Create Dask executor for mrun

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    c54592a View commit details
    Browse the repository at this point in the history

  2. Dask entry point and cli options for mrun

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    538da32 View commit details
    Browse the repository at this point in the history

  3. Dask dependencies

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    5d0f4e3 View commit details
    Browse the repository at this point in the history

  4. remove explicit setting of Python arg names

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    58dd6fd View commit details
    Browse the repository at this point in the history

  5. update scheduler help

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    266c374 View commit details
    Browse the repository at this point in the history

  6. add dask-threads option

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    c0cc38a View commit details
    Browse the repository at this point in the history

  7. change mem limit accepted values to match dask cli + update help text

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    7754bd0 View commit details
    Browse the repository at this point in the history

  8. option for dashboard port

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    34cc7e0 View commit details
    Browse the repository at this point in the history

  9. change hosts to hostfile to be consistent with dask cli

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    46b1f52 View commit details
    Browse the repository at this point in the history

  10. typo in asyncssh name

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    d81ff89 View commit details
    Browse the repository at this point in the history

  11. sort dask related args

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    41f58ec View commit details
    Browse the repository at this point in the history

  12. update arg names and cluster kwargs

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    1742485 View commit details
    Browse the repository at this point in the history

  13. cluster misspelled

    @tsmathis
    tsmathis committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    8a5aaca View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. Wrong brackets for Union type

    @tsmathis
    tsmathis committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    7373768 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. Settings thread count to 0 is deprecated

    @tsmathis
    tsmathis committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    05597d9 View commit details
    Browse the repository at this point in the history

  2. add builder class name to dask task key, tokenize index of each chunk… 

    … for use as post-fix for dask task key
    @tsmathis
    tsmathis committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    a28f001 View commit details
    Browse the repository at this point in the history

  3. add option for saving diagnostics report from dask dashboard

    @tsmathis
    tsmathis committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    245cf3e View commit details
    Browse the repository at this point in the history