Skip to content
This repository has been archived by the owner on Nov 21, 2022. It is now read-only.

Shuffling support #298

Open
juliusfrost opened this issue Oct 24, 2022 · 0 comments
Open

Shuffling support #298

juliusfrost opened this issue Oct 24, 2022 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@juliusfrost
Copy link

馃殌 Feature

Add option for data shuffling in core/data.py
Data shuffling is crucial for removing dataset structure bias.

Motivation

I noticed my model was not performing well when I was using a custom dataset with spikes in performance across the epoch.
I then realized it was because the class data was in sequence, and there was no shuffling performed by default.
I then looked into the code but couldn't find any option to add shuffling: core/data.py
I had to then overwrite 3 functions, train_dataloader, val_dataloader, test_dataloader in order to get this functionality.

Pitch

Add a boolean shuffling argument in the constructor that enables this.

Alternatives

Additional context

@juliusfrost juliusfrost added enhancement New feature or request help wanted Extra attention is needed labels Oct 24, 2022
@Borda Borda mentioned this issue Nov 21, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant