You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Nov 21, 2022. It is now read-only.
Add option for data shuffling in core/data.py
Data shuffling is crucial for removing dataset structure bias.
Motivation
I noticed my model was not performing well when I was using a custom dataset with spikes in performance across the epoch.
I then realized it was because the class data was in sequence, and there was no shuffling performed by default.
I then looked into the code but couldn't find any option to add shuffling: core/data.py
I had to then overwrite 3 functions, train_dataloader, val_dataloader, test_dataloader in order to get this functionality.
Pitch
Add a boolean shuffling argument in the constructor that enables this.
Alternatives
Additional context
The text was updated successfully, but these errors were encountered:
🚀 Feature
Add option for data shuffling in core/data.py
Data shuffling is crucial for removing dataset structure bias.
Motivation
I noticed my model was not performing well when I was using a custom dataset with spikes in performance across the epoch.
I then realized it was because the class data was in sequence, and there was no shuffling performed by default.
I then looked into the code but couldn't find any option to add shuffling: core/data.py
I had to then overwrite 3 functions,
train_dataloader
,val_dataloader
,test_dataloader
in order to get this functionality.Pitch
Add a boolean shuffling argument in the constructor that enables this.
Alternatives
Additional context
The text was updated successfully, but these errors were encountered: