May I know when will the leaderboard be fixed？ #76
|
Some questions about leaderboard should be fixed:
By the way, the current fake score from my submission is generated by the gru baseline, is it possible to fix it? |
Replies: 2 comments
|
Hi, there,
1. The false high ranks have been updated partially and it is still in
progress.
2. test_y is located at different locations compared to test_x and the
evaluation script, so as to the submitted zip file.
Thanks for your kind advise.
Regards,
Xinjiang Lu
…On Thu, May 19, 2022 at 10:02 AM ZiwenYeee ***@***.***> wrote:
Some questions about leaderboard should be fixed:
1.
Missing value in submission. In the evaluation script, if submission
contains missing values, the score of missing value part will be counted as
zero. Does it mean that all the score in the public leaderboard is wrong?
If so, can we get the right score for all the past submissions or earn more
chances to submit?
2.
It seems that test_y can be assessed by envs["path_to_test_y"], should
it be hidden?
By the way, the current fake score from my submission is generated by the
gru baseline, is it possible to fix it?
—
Reply to this email directly, view it on GitHub
<#76>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEVHY35X3FCVSKVTYUQKUK3VKWOLVANCNFSM5WKMHC4A>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
|
|
Hi, The online tests have been updated to avoid the false high scores, please refer to the GitHub(https://github.com/PaddlePaddle/PaddleSpatial/tree/main/apps/wpf_baseline_gru/kddcup22-sdwpf-evaluation) updates for more details. The leaderboard is also updated |
Hi,
The online tests have been updated to avoid the false high scores, please refer to the GitHub(https://github.com/PaddlePaddle/PaddleSpatial/tree/main/apps/wpf_baseline_gru/kddcup22-sdwpf-evaluation) updates for more details.
The leaderboard is also updated