Dear Authors,
thank you for the great work and excellent code.
I have been trying out your Model with 101 Layers on the iBims benchmark and I got the following results:
rel = 0.18252209
sq_rel = 0.31786942
rms = 1.007896
log10 = 0.09304994
thr1 = 0.6706134
thr2 = 0.8888803
thr3 = 0.953198
dde_0 = 0.8467216
dde_p = 0.014197141
dde_m = 0.13908128
pe_fla = 3.2895006910848283
pe_ori = 9.120579389065199
dbe_acc = 2.3114917
dbe_com = 44.03281
As you can see, most numbers are equal to the ones you report in your paper, but the Edge Completeness metric dbe_com is 44 instead of the reported 6.59 in the paper. I am using the ibims command you provide and the original iBims evaluation scripts. Do you have an idea on why I am observing this wrong value?
I hope you can help me out!
Best Regards
Niclas
Dear Authors,
thank you for the great work and excellent code.
I have been trying out your Model with 101 Layers on the iBims benchmark and I got the following results:
rel = 0.18252209
sq_rel = 0.31786942
rms = 1.007896
log10 = 0.09304994
thr1 = 0.6706134
thr2 = 0.8888803
thr3 = 0.953198
dde_0 = 0.8467216
dde_p = 0.014197141
dde_m = 0.13908128
pe_fla = 3.2895006910848283
pe_ori = 9.120579389065199
dbe_acc = 2.3114917
dbe_com = 44.03281
As you can see, most numbers are equal to the ones you report in your paper, but the Edge Completeness metric dbe_com is 44 instead of the reported 6.59 in the paper. I am using the ibims command you provide and the original iBims evaluation scripts. Do you have an idea on why I am observing this wrong value?
I hope you can help me out!
Best Regards
Niclas