why code has great difference with idea in paper?

[shuchao97]

hello, author. Recently, I have trained the model, but its' performance has great gaps whith your results in your paper. At the same time, why code has great difference with idea in paper?
@leolyj @DuoPeng-CVer

[AronCao49]

Same issue.

When I directly run this repo on A2D2 -> KITTI, the val mIoU of 2D and 3D prediction can only achieve 25.3 and 30.6, respectively. It seems that the provided code can not achieve the performance they stated in their ICCV paper...at least not with the current form.

[shuchao97]

Same issue.

When I directly run this repo on A2D2 -> KITTI, the val mIoU of 2D and 3D prediction can only achieve 25.3 and 30.6, respectively. It seems that the provided code can not achieve the performance they stated in their ICCV paper...at least not with the current form.
Hello.
May I ask how long it took you to train the model on a2d2->Semantickitti. In the other two scenarios, such as USA->Singapore and day->night in Nuscenes, how much mIOU can it reach?

[AronCao49]

Hello.
May I ask how long it took you to train the model on a2d2->Semantickitti. In the other two scenarios, such as USA->Singapore and day->night in Nuscenes, how much mIOU can it reach?

Approximately 3-4 days using RTX3090+i5-8600K.
As soon as I observe this unsatisfactory performance on KITTI and our self-collected dataset, I realize this might be inapplicable, so I shift to xMUDA directly without testing on nuScenes.