model load error

[ericyq]

TypeError: init() got an unexpected keyword argument 'batch_first'

File "train_video.py", line 208, in init_model
model = CLIP4Clip.from_pretrained(args.cross_model, cache_dir=cache_dir, state_dict=model_state_dict, task_config=args)
Cap4Video/modules/modeling_tv_titles_video.py", line 285, in init
self.caption_transformer_layer = nn.TransformerEncoderLayer(d_model=transformer_width,
nhead=transformer_heads,
dim_feedforward=transformer_width, dropout=0,
batch_first=True)

[ericyq]

need to torch=1.9.0
or
self.caption_transformer_layer = nn.TransformerEncoderLayer(d_model=transformer_width,
nhead=transformer_heads,
dim_feedforward=transformer_width, dropout=0)