Hello!
I tried to reproduce the experiment described in Section 3.2. I used the same hyperparameter setup presented in Supplementary Table 3. The PCL component yielded 61.87% contrast accuracy compared to the 81.11% reported in the paper.
The only modification was to remove 5 images with missing labels from the dataset and use 331 instead of 336. The results can be seen in the table below. I repeated the NaroNet training with the same embeddings 5 times to analyze how the results vary.
Do you have any idea why this happens?
Thanks in advance!
Hello!
I tried to reproduce the experiment described in Section 3.2. I used the same hyperparameter setup presented in Supplementary Table 3. The PCL component yielded 61.87% contrast accuracy compared to the 81.11% reported in the paper.
The only modification was to remove 5 images with missing labels from the dataset and use 331 instead of 336. The results can be seen in the table below. I repeated the NaroNet training with the same embeddings 5 times to analyze how the results vary.
Do you have any idea why this happens?
Thanks in advance!