Error in Antmaze environments

[QinwenLuo]

When I run run_aca.py for antmaze, this error will occur:
AttributeError: module 'd3rlpy.preprocessing.reward_scalers' has no attribute 'ConstantShiftRewardScaler'

My conda environment satisfy all the requirements listed in requirementstxt, maybe the requirement for d3rlpy is wrong?

[ZishunYu]

Hi Qinwen

Sorry for the late response as I was on vacation last month (due to the new year). Yes, it seems d3rlpy 1.x does not have the ConstantShiftRewardScaler. Could you try StandardRewardScaler with manually setting the mean and std?

scaler = d3rlpy.preprocessing.StandardRewardScaler(mean=[ConstShift], std=1.0)

This should achieve desired reward transformation.

[Criswim]

Hi Qinwen

Sorry for the late response as I was on vacation last month (due to the new year). Yes, it seems d3rlpy 1.x does not have the ConstantShiftRewardScaler. Could you try StandardRewardScaler with manually setting the mean and std?

scaler = d3rlpy.preprocessing.StandardRewardScaler(mean=[ConstShift], std=1.0)

This should achieve desired reward transformation.

What should the 'ConstShift' be? Is '-1.0' the right value?