[ghstack-poisoned]

The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.


[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` and `DataLoader2` as public methods.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

This PR doesn't handle pausing or resuming with `sharding_round_robin_dispatch`. This will be fixed in an upcoming PR and is tracked by #991.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

This PR doesn't handle pausing or resuming with `sharding_round_robin_dispatch`. This will be fixed in an upcoming PR and is tracked by #991.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

This PR doesn't handle pausing or resuming with `sharding_round_robin_dispatch`. This will be fixed in an upcoming PR and is tracked by #991.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

This PR doesn't handle pausing or resuming with `sharding_round_robin_dispatch`. This will be fixed in an upcoming PR and is tracked by #991.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

This PR doesn't handle pausing or resuming with `sharding_round_robin_dispatch`. This will be fixed in an upcoming PR and is tracked by #991.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

This PR doesn't handle pausing or resuming with `sharding_round_robin_dispatch`. This will be fixed in an upcoming PR and is tracked by #991.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

This PR doesn't handle pausing or resuming with `sharding_round_robin_dispatch`. This will be fixed in an upcoming PR and is tracked by #991.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]

…lt DataPipes"


The goal of this PR is fully stop DataPipe activities in preparation of snapshotting (which requires a halted state), so buffers will not be changing while we record the snapshot.

This PR doesn't handle pausing or resuming with `sharding_round_robin_dispatch`. This will be fixed in an upcoming PR and is tracked by #991.

---
Implementation note (feel free to discuss):
`_pause` exists for both `DataLoader2Iterator` and `DataLoader2` as private methods.
`resume` exists for both `DataLoader2Iterator` as public but it is private for `DataLoader2`.

`limit` and `clear_limit` exist only for `DataLoader2Iterator` as a public methods.
- Limit persists through iterations (with the iterator) until it is manually cleared via `clear_limit`.
- Creating a new iterator (`iter(dl2)`) will not retain the previous limit, because the limit is attached to the iterator.

Differential Revision: [D41744759](https://our.internmc.facebook.com/intern/diff/D41744759)

[ghstack-poisoned]