Hi, thanks for releasing the code.
I tried to reproduce the reported results in this repository, but I can
currently only reach 80.92 on my side, which is noticeably below the
number reported in the paper/README.
Could you clarify the exact reproducibility setup?
My questions are:
- What is the exact command sequence used for the final reported result?
- Which commit/version of the repository was used?
- Are there any missing files, scripts, or preprocessing steps that are not
included in the public repo?
- Which checkpoint/assets from Zenodo are strictly required?
- What random seeds and number of runs were used for the reported number?
- Are there any training details not reflected in the README, such as batch
size, effective learning rate, augmentation settings, thresholding, warmup, or
evaluation protocol?
My current reproduction result:
- Best result reproduced: 80.92
- Repository:
khtks/DWD
- Dataset/task: cifar10/100
If needed, I can also share logs and config files. Right now it seems that the
public repository may be missing some details required to match the reported
result.
Thanks.
Hi, thanks for releasing the code.
I tried to reproduce the reported results in this repository, but I can
currently only reach 80.92 on my side, which is noticeably below the
number reported in the paper/README.
Could you clarify the exact reproducibility setup?
My questions are:
included in the public repo?
size, effective learning rate, augmentation settings, thresholding, warmup, or
evaluation protocol?
My current reproduction result:
khtks/DWDIf needed, I can also share logs and config files. Right now it seems that the
public repository may be missing some details required to match the reported
result.
Thanks.