About evaluating on Referit3D

Hi, thanks for your wonderful work.
Will the evaluation code on Referit3D be released?
Thanks!

[yanx27]

@hsuanlyh1997 Yes, we will release codes for Referit3D in the future.

[ayushjain1144]

Hi @yanx27, thanks for your awesome work. Could you please release it soon? I tried to reproduce results for referit3d using your code but I am getting the following results:

overall | overall | acc@0.25iou: 0.3151
overall | overall | acc@0.5iou: 0.2525

Probably I am doing something wrong, but anyway a trained checkpoint for SR3D and NR3D would be really helpful.
Thanks!

[CurryYuan]

Hi @ayushjain1144 , the Acc@mIoU is only used in ScanRefer. For referit3d, we use GT instance as input and evaluate the grounding accuracy solely. Please refer to their paper for details. I think the result will be much higher if you follow this setting.