Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make DistributedSampler stateful #1315

Merged
merged 16 commits into from
Aug 28, 2024
Merged

Make DistributedSampler stateful #1315

merged 16 commits into from
Aug 28, 2024

Commits on Aug 21, 2024

  1. make distributed sampler stateful

    @ramanishsingh
    ramanishsingh committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    b0a7963 View commit details
    Browse the repository at this point in the history

  2. run black

    @ramanishsingh
    ramanishsingh committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    2e33f9c View commit details
    Browse the repository at this point in the history

  3. add tests

    @ramanishsingh
    ramanishsingh committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    6c6ef78 View commit details
    Browse the repository at this point in the history

  4. run black

    @ramanishsingh
    ramanishsingh committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    b6c71d8 View commit details
    Browse the repository at this point in the history

  5. remove unncessary import

    @ramanishsingh
    ramanishsingh committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    2e431ef View commit details
    Browse the repository at this point in the history

  6. run precommit

    @ramanishsingh
    ramanishsingh committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    306431e View commit details
    Browse the repository at this point in the history

  7. import math in sampler.py

    @ramanishsingh
    ramanishsingh committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    fe08bfc View commit details
    Browse the repository at this point in the history

  8. define methods in _StatefulDistributedSamplerIterator

    @ramanishsingh
    ramanishsingh committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    0dce976 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. remove unnecessary repetition of methods

    @ramanishsingh
    ramanishsingh committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    fb0a187 View commit details
    Browse the repository at this point in the history

  2. run precommit

    @ramanishsingh
    ramanishsingh committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    4d014e5 View commit details
    Browse the repository at this point in the history

  3. add tests

    @ramanishsingh
    ramanishsingh committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    cdc5d31 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2024

  1. updated dataloader types in tests

    @ramanishsingh
    ramanishsingh committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    1851799 View commit details
    Browse the repository at this point in the history

  2. Update torchdata/stateful_dataloader/sampler.py 

    Co-authored-by: Andrew Ho <[email protected]>
    @ramanishsingh @andrewkho
    ramanishsingh and andrewkho authored Aug 25, 2024
    Configuration menu
    Copy the full SHA
    352c59f View commit details
    Browse the repository at this point in the history

  3. add itertools import

    @ramanishsingh
    ramanishsingh committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    a13679c View commit details
    Browse the repository at this point in the history

  4. update tests

    @ramanishsingh
    ramanishsingh committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    d93d3c4 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. remove unnecessary imports

    @ramanishsingh
    ramanishsingh committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    c024661 View commit details
    Browse the repository at this point in the history