Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Data parallel training support #79

Merged
merged 15 commits into from
Dec 7, 2023
Merged

Data parallel training support #79

merged 15 commits into from
Dec 7, 2023

Commits on Dec 7, 2023

  1. abstract communicator and mpi4py implementation

    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    a99cd84 View commit details
    Browse the repository at this point in the history

  2. * correct loading and building logic for parallel simulation 

    * NCCL init
    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    d6088dd View commit details
    Browse the repository at this point in the history

  3. pass communicator object through compilers to compiled model and set … 

    …NCCL flag when constructing GeNNModel
    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    9b8eb71 View commit details
    Browse the repository at this point in the history

  4. pass communicator object through to Metric.update and use to correctl… 

    …y calculate metrics
    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    13a3e89 View commit details
    Browse the repository at this point in the history

  5. whitespace

    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    bbdbd3a View commit details
    Browse the repository at this point in the history

  6. * add Compiler.full_batch_size for scaling and testing whether model … 

    …is batched at all

* divide batch size by number of ranks
    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    23afe1d View commit details
    Browse the repository at this point in the history

  7. example of using MPI communicator

    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    2429e5d View commit details
    Browse the repository at this point in the history

  8. whitespace

    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    3bad75c View commit details
    Browse the repository at this point in the history

  9. fixed typos

    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    ec0de58 View commit details
    Browse the repository at this point in the history

  10. whitespace

    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    7458592 View commit details
    Browse the repository at this point in the history

  11. MPI communicator fixes

    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    8588dfd View commit details
    Browse the repository at this point in the history

  12. hacky around GeNN bug

    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    e6747f9 View commit details
    Browse the repository at this point in the history

  13. fixed typos in few spike compiler and compiled network

    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    9309a50 View commit details
    Browse the repository at this point in the history

  14. add SHD eprop MPI example and rename checkpoints

    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    1f35746 View commit details
    Browse the repository at this point in the history

  15. updated MPI examples and added shell scripts

    @neworderofjamie
    neworderofjamie committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    7e913ae View commit details
    Browse the repository at this point in the history