Evaluate the metrics question

[Yippr]

Thank you for your work. I used the 26.3M pretrained weights you provided, but the driving score I obtained is somewhat low. I'm having some problems evaluating metrics.Could you please confirm if the weights you provided were trained after using PlanKD? Is there anything I should pay attention to during the evaluation process?

[tulerfeng]

Thank you for your question. I can confirm that the weights are accurate. The evaluation results on Town05 Long and Town05 Short in the CARLA simulator often exhibit significant variance. Therefore, if your score in a single evaluation is somewhat lower or higher (e.g., ±10), this is normal. You can try to run multiple times for evaluations to observe a more consistent average score.