Hi there!
My question is - is there any particular reason for creating the entire dataset and dataloader every epoch from scratch? This is done in the PyTorch version, in the main_train file:
As I see it - it doesn't add anything because the addition of the noise is done in the 'get_item' function, so the noise is randomized any way a batch is drawn anyway. So this creation takes time from computing the same dataloader each epoch, without adding value.
Am I missing something? Please correct me if I'm wrong
Hi there!
My question is - is there any particular reason for creating the entire dataset and dataloader every epoch from scratch? This is done in the PyTorch version, in the main_train file:
As I see it - it doesn't add anything because the addition of the noise is done in the 'get_item' function, so the noise is randomized any way a batch is drawn anyway. So this creation takes time from computing the same dataloader each epoch, without adding value.
Am I missing something? Please correct me if I'm wrong